-- Logs begin at Tue 2021-11-02 16:02:22 UTC, end at Tue 2021-11-02 17:05:30 UTC. -- Nov 02 16:37:10.009537 dv-cinder-773876-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 16:37:10.021259 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 16:37:10.024157 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 2 16:37:10 2021] *** Nov 02 16:37:10.024157 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 16:37:10.024157 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 16:37:10.024157 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: nodename: dv-cinder-773876-4-iscsi Nov 02 16:37:10.024157 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: machine: x86_64 Nov 02 16:37:10.024157 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: clock source: unix Nov 02 16:37:10.024157 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: pcre jit disabled Nov 02 16:37:10.024157 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: detected number of CPU cores: 4 Nov 02 16:37:10.024157 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: current working directory: / Nov 02 16:37:10.024157 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: detected binary path: /usr/bin/uwsgi-core Nov 02 16:37:10.024962 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: your processes number limit is 47680 Nov 02 16:37:10.024962 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: your memory page size is 4096 bytes Nov 02 16:37:10.024962 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: detected max file descriptor number: 2048 Nov 02 16:37:10.024962 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: lock engine: pthread robust mutexes Nov 02 16:37:10.024962 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: thunder lock: enabled Nov 02 16:37:10.024962 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 16:37:10.024962 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 02 16:37:10.073953 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: Python main interpreter initialized at 0x561b2cd7d9c0 Nov 02 16:37:10.073953 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: python threads support enabled Nov 02 16:37:10.073953 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: your server socket listen backlog is limited to 100 connections Nov 02 16:37:10.073953 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: your mercy for graceful operations on workers is 90 seconds Nov 02 16:37:10.074508 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 16:37:10.074508 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: *** Operational MODE: preforking *** Nov 02 16:37:10.074869 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: *** uWSGI is running in multiple interpreter mode *** Nov 02 16:37:10.074869 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: spawned uWSGI master process (pid: 112638) Nov 02 16:37:10.075153 dv-cinder-773876-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 16:37:10.076050 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: spawned uWSGI worker 1 (pid: 112647, cores: 1) Nov 02 16:37:10.076528 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: spawned uWSGI worker 2 (pid: 112648, cores: 1) Nov 02 16:37:10.076754 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 16:37:11.886770 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 16:37:11.886770 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: from cryptography.utils import int_from_bytes Nov 02 16:37:11.887681 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 16:37:11.887681 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: from cryptography.utils import int_from_bytes Nov 02 16:37:11.975166 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 16:37:11.975166 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: from cryptography.utils import int_from_bytes Nov 02 16:37:11.976054 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 16:37:11.976054 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: from cryptography.utils import int_from_bytes Nov 02 16:37:14.724984 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 16:37:14.725739 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 16:37:14.725739 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 16:37:14.726317 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 16:37:14.726437 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 16:37:14.726539 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 16:37:14.726647 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 16:37:14.726758 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 16:37:14.726858 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 16:37:14.726965 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 16:37:14.727086 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.727179 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.727274 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.727374 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.727471 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.727581 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.727782 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.727904 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.728088 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.728324 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.728450 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.728693 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.728890 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.729067 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.729203 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.729413 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.729726 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.729847 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.729934 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.730070 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.730171 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.730475 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773876-4-iscsi {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.730641 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.730789 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.730929 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773876-4-iscsi {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.731058 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.731187 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.731337 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.731466 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.731594 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.731818 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.731989 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.732159 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.732437 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.732595 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.732758 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.732904 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.733103 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.733654 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.733906 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.734103 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.734365 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.734596 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.734793 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.735018 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.735211 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.735418 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.735633 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.735853 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.736091 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.736381 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.736623 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.736786 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.737027 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.737171 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.737444 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.737699 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.737936 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.738079 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.738079 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.738448 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773876-4-iscsi {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.738448 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.739515 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773876-4-iscsi {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.739684 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.739867 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.740025 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.740210 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.740557 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.740713 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.740947 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.741160 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.741357 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.741598 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.741777 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.741777 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.742284 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.742443 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.742663 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.742807 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.742980 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.743124 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.743277 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.743515 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.743677 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.743856 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.744003 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.744249 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.744396 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.746147 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.746298 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.746482 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.746717 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.746884 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.747046 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.747207 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.747350 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.747521 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.747681 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.747932 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.748155 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.748340 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.748519 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.748676 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.748845 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.748989 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.749157 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.749337 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.749503 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.749503 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.749785 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.749785 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.750073 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.750073 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.750367 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.750794 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.750964 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.751139 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.751281 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.751467 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.751611 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.751776 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.751930 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.752079 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.752284 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.752446 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.752598 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.752760 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.752912 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.753064 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.753238 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.753386 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.753538 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.753715 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.753860 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.754037 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.754203 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.754350 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.755120 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.755300 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.755470 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.755619 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.755794 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.755941 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.756110 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.118 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.756281 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.756462 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.118 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.756606 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.118 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.756786 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.756938 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.118 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.757093 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.757243 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.757414 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.757590 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.757735 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.757906 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.758136 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.758546 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.758810 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.759056 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.759202 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.759442 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.759585 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.759755 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.759905 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.760080 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.760365 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.760509 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.760509 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.761078 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.761223 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.761223 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.761522 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.761722 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.761889 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.762044 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.762219 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.762376 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.762521 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.762680 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.762842 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.762990 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.763246 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.763388 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.763554 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.763697 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.763951 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.764120 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.764384 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.764543 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.764697 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.764931 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.764931 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.765246 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.765412 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.765412 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.765814 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.766043 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.766218 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.766393 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.766554 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.766768 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.766953 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.767105 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.767268 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.767519 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.767670 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.767826 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.767991 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.768137 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.768441 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.768605 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.768818 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.768961 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.769111 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.769263 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.769431 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.769595 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.769595 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.769595 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.769595 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.770155 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.770307 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.770307 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.770618 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.770812 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.770812 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.770812 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.771503 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.771681 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.771681 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.771962 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.772117 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.772117 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.775484 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.776047 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.776047 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.776375 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.776491 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.776578 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.776670 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.776788 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.776889 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.776999 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.777162 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.777323 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.777442 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.777559 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.777659 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.777756 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.777865 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.777865 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.778074 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.778173 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.778173 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.778348 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.778498 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.778618 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.778732 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.778832 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.778928 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.779024 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.779120 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.779217 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.779334 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.779445 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.779544 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.779653 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.779751 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.779862 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.779970 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.780070 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.780166 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.780289 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.780386 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.780503 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.780604 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.780715 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.780824 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.780923 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.781019 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.781138 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.781270 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.781633 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.781753 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.781854 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.781951 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.782064 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:37:14.782064 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.782237 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.782348 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.782448 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.782560 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.782660 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.782758 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.782855 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.782951 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.783048 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.783159 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.783258 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.783354 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.783462 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.783573 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.783693 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.783814 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.783926 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.784064 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.784260 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.784366 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.784366 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.784565 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.784677 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.784777 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.784874 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.784971 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.785068 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.785265 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.785367 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.785476 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.785575 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.785757 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.785907 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.786169 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.786256 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.786337 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.786416 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.786502 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.786672 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.786883 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.786985 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.786985 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.786985 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.786985 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.786985 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.786985 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.787447 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.787529 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.787609 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.787688 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.787807 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.787908 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.788006 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.788102 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.788236 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.788340 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.788451 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.788551 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.788723 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.788831 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.788929 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.789040 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.789140 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.789238 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.789334 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.789431 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.789529 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.789646 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.789758 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.789857 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.789956 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.790052 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.790229 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.790350 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.790451 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.790549 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.790646 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.790743 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.790838 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.790949 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.791048 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.791146 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.791335 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.791441 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.791770 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.791893 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.792077 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.792253 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.792423 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.792539 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.792723 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.792830 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.793067 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.793180 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.793431 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.793615 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.793800 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.793964 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.794132 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.794317 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.794497 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.794662 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.794841 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.795016 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.795181 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.795356 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.795521 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.795698 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.795863 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.796028 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.796219 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.796386 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.796565 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.796755 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.796925 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.797101 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.797274 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.797393 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.797491 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.797589 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.797688 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.797782 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.797866 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.798071 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.798176 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.798404 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.798496 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.798738 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.798828 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.799091 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.799196 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.799453 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.799555 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.799840 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.799946 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.800065 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.800204 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.800423 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.800538 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.800745 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.800836 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.801071 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.801175 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.801973 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.802233 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.802387 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.803184 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.803351 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.803544 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.803709 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.803709 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.804082 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.804304 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.804304 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.804660 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.804824 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.804988 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.805151 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.805151 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.805476 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.805642 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.805819 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.805989 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.806168 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.806333 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.806333 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.806680 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.806846 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.807010 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.807175 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.807339 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.807516 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.807683 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.807849 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.808024 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.808233 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.808432 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.808604 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.808764 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.808931 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.809096 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.809261 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.809445 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.809611 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.809776 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.809963 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.810139 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.810317 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.810497 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.810676 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.810853 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.811020 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.811184 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.811348 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.811526 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.811690 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.811865 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.812069 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.812339 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.812445 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.812610 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.812716 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.812814 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.812910 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.813007 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.813117 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.813216 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.813313 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.813409 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.813517 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.813517 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.813813 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.813917 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.814015 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.814112 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.814251 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.814354 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.814556 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.814665 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.814894 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.815002 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.815257 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.815377 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.815592 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.815700 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.815920 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.816028 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.816281 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.816443 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.816605 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.816785 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.816966 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.817693 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.817989 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.818096 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.818428 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.818560 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.818663 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.818759 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.818984 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.819107 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.819321 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.819424 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.819646 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.819749 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.819974 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.820096 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.820330 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.820438 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.820654 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.820777 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.820978 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.821084 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.821306 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.821410 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.821628 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.821731 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.821951 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.822063 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.822277 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.822381 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.822598 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.822748 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.822929 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.823078 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.823264 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.823423 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.823575 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.823680 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.823898 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.824002 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.824250 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.824359 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.824597 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.824762 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.824925 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.825097 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.825286 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.825588 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.825695 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.825907 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.826082 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.826228 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.826570 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.826673 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.826896 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.827121 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.827226 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.827520 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.827679 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.827840 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.828134 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.828363 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.828530 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.828693 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.828873 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.829036 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.829200 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.829379 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.829550 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.829817 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.829978 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.830143 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.830339 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.830527 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.830698 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.830861 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.831027 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.831205 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.831389 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.831554 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.831718 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.831883 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.832085 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.832288 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.832490 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.832627 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.833000 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.833186 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.833283 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.833366 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.833462 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.833750 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.833750 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.834065 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.834229 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.834406 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.834580 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.834756 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.834920 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.835112 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.835277 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.835455 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.835637 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.835814 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.835814 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.836125 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.836312 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.836493 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.836668 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.836833 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.836996 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.837175 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.837349 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.837529 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.837704 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.837867 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.838040 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.838204 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.838381 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.838545 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.838708 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.838872 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.839034 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.839198 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.839394 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.839559 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.839736 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.839901 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.840065 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.840281 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.840417 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.840575 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.840743 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.840910 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.840910 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.841219 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.841409 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.841598 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.841766 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.841766 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.842086 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.842265 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.842265 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.842597 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.842793 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.842793 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.843142 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.843247 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.843359 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.843587 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.843797 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.843903 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.844257 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.844558 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.844684 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.844880 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.845133 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.845250 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.845497 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.845602 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.845845 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.845949 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.846201 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.846306 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.846550 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.846655 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.846895 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.847003 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.847218 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.847321 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.847541 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.847666 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.847871 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.847974 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.848257 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.848386 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.848747 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.848878 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.849033 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.849124 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.849500 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.849628 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.849729 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.849844 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.850019 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.850186 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.850333 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.850487 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.850704 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.850908 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.851070 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.851228 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.851386 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.851552 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.851772 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.851958 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.852086 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.852220 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.852395 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.852524 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.852667 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.852804 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.852963 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.853126 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.853272 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.853419 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.853552 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.853712 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.853852 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.853957 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.854042 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.854270 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.854375 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.854600 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.854710 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.854914 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.855021 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.855279 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.855596 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.855754 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.855976 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.856081 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.856336 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.856433 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.856672 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.856859 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.857015 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.857231 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.857324 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.857477 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.857650 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.857805 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.857982 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.858132 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.858313 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.858465 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.858638 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.858800 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.858960 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.859124 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.859286 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.859458 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.859626 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.859783 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.859924 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.860113 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.860316 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.860428 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.860604 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.860754 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.860959 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.861089 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.861281 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.861416 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.861698 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.861817 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.861933 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.862066 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.862229 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.862392 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.862550 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.862716 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.862882 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.863065 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.863184 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.863482 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.863603 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.864334 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.864450 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.864676 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.864769 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.865000 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.865091 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.865346 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.865463 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.865695 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.865870 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.866013 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.866118 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.866335 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.866438 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.866657 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.866847 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.867107 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.867272 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.867444 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.867598 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.869211 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.869398 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.869549 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.869682 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.869811 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.869954 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.870085 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.870085 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.870388 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.870525 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.870665 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.870828 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.870828 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.871105 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.871332 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.871502 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.871661 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.871804 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.871984 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.872168 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.872395 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.872538 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.872675 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.872675 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.872949 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.873094 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.873094 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.873403 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.873565 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.873721 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.873916 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.873916 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.874083 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.874177 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.874271 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.874372 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.874455 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.874547 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.874707 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.874861 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.875010 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.875155 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.875244 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.875326 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.875458 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.875569 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.875794 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.875959 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.876126 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.876356 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.876521 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.876684 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.876881 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.877360 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.877542 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.877668 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.877790 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.877935 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.878068 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.878171 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.878345 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.878477 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.878689 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.878790 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.879173 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.879292 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.879392 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.879559 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.880324 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.880545 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.880669 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.880956 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.881172 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.881394 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.881500 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.881725 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.881902 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.882054 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.882162 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.882377 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.882481 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.882705 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.882811 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.883037 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.883141 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.883627 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.883742 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.883962 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.884067 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.884312 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.884483 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.884700 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.884832 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.885039 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.885132 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.885371 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.885461 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.885698 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.885788 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.886019 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.886110 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.886341 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.886438 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.886667 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.886757 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.887010 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.887101 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.887334 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.887424 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.887655 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.887760 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.887973 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.888064 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.888345 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.888469 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.888667 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.888772 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.889006 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.889317 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.889468 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.889763 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.889881 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.890089 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.890220 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.890528 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.890636 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.890851 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.890958 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.891176 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.891284 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.891520 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.891645 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.891858 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.891984 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.892208 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.892350 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.892539 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.892634 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.892879 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.892991 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.893213 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.893315 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.893549 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.893640 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.893887 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.893991 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.894216 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.894305 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.894545 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.894695 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.894868 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.895088 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.895511 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.895619 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.895786 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.895925 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.896074 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.896276 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.896475 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.896718 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.896858 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.897061 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.897215 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.897392 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.897740 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.897843 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.898085 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.898376 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.898501 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.898715 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.898855 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.899025 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.899256 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.899439 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.899737 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.899988 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.900144 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.900366 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.900467 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.900649 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.900937 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.901056 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.901283 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.901511 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.901616 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.901909 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.902080 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.902250 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.902578 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.902682 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.902917 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.903228 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.903334 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.903573 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.903785 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.903893 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.904245 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.904400 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.904586 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.904912 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.905015 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.905234 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.905547 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.905657 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.905865 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.906146 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.906263 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.906533 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.906873 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.907148 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.907267 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.907558 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.908418 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.908532 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.908619 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.908702 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.908813 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.908900 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.909141 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.909247 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.909481 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.909572 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.909823 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.909915 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.910146 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.910251 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.910469 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.910591 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.911445 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.911651 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.911769 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.912094 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.912354 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.912474 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.912623 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.912762 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.912988 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.913104 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.913353 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.913474 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.913697 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.913800 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.914036 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.914156 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.914358 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.914586 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.914761 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.914882 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.914983 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.915068 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.915316 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.915480 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.915646 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.915842 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.915952 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.916147 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.916441 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.916602 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.916707 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.916873 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.916991 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.917302 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.917514 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.917629 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.917976 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.918107 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.918302 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.918410 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.918645 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.918751 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.918979 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.919084 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.919333 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.919467 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.919665 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.919769 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.920000 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.920093 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.920391 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.920569 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.920696 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.920788 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.921032 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.921133 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.921355 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.921606 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.921709 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.922231 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.922399 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.922548 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.922826 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.923106 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.923293 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.923554 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.923811 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.924047 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.924386 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.924576 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.924796 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.924986 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.925315 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.925899 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.926109 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.926377 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.926563 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.927251 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.927501 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.927690 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.928060 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.928349 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.928634 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.929149 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.929433 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.929721 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.930240 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.930773 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.930959 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.931221 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.931407 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.931609 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.931924 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.932113 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.932539 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.932721 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.932935 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.933247 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.933425 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.933604 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.933786 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.933980 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.934159 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.934360 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.934537 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.934716 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.934907 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.935086 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.935361 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.935546 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.935866 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.936422 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.936929 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.937125 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.937417 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.937924 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.938316 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.938504 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.938787 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.938969 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.939171 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.939409 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.939596 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.939790 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.939997 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.940238 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.940467 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.940644 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.940891 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.941143 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.941348 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.941548 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.941852 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.942169 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.942361 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.942806 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.943375 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.943593 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.943949 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.944391 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.944775 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.945013 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.945350 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.945679 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.945881 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.946073 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.946254 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.946526 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.946736 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.946915 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.947088 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.947282 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.947544 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.947725 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.947923 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.948224 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.948412 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.948756 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.948969 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.949211 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.949414 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.949592 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.949863 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.950049 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.950223 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.950421 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.950599 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.950843 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.951183 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.951403 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.951587 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.951835 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.952016 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.952229 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.952551 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.952768 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.953024 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.953235 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.953415 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.953593 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.953768 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.953944 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.954262 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.954465 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.954645 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.954816 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.955013 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.955310 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.955518 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.955696 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.955927 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.956133 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.956379 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.956537 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.956755 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.956987 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.957168 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.957362 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.957654 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.957949 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.958358 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.958539 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.958804 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.958989 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.959219 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.959418 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.959806 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.959994 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.960224 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.960400 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.960579 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.960912 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.961160 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.961397 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.961622 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.961910 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.962119 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.962294 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.962537 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.962720 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.963057 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.963243 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.963489 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.963667 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.963842 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.964205 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.964393 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.964634 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.964832 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.965010 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.965349 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.965535 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.965877 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.966063 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.966399 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.966652 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.966937 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.967142 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.967468 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.967691 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.967916 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.968094 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.968358 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.968562 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.968756 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.968954 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.969201 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.969399 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.969592 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.969765 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.969940 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.970268 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.970457 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.970781 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.971030 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.971276 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.971506 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.971755 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.971937 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.972412 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.972600 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.972848 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.973059 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.974140 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.974321 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.974519 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.974769 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.974967 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.975248 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.975440 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.975618 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.975791 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.975984 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.976304 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.976644 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.976828 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.977102 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.977363 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.977548 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.977911 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.978122 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.978433 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.978639 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.978957 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.979151 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.979485 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.979669 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.980000 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.980235 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.980551 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.980736 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.981077 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.981287 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.981741 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.981929 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.982192 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.982377 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.982710 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.982941 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.983245 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.983495 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.983789 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.984057 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.984378 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.984670 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.984906 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.985244 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.985445 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.985816 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.986003 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.986387 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.986591 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.986934 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.987136 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.987495 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.987890 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.988079 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.988314 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.988605 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.989682 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.990163 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.990342 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.990520 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.990695 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.990926 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.991108 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.991424 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.991601 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.991874 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.992053 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.992325 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.992527 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.992704 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.992897 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.993074 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.993249 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.993446 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.993807 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.993953 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.994243 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.994363 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.994684 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.994814 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.995111 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.995223 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.995464 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.995587 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.995811 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.996057 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.996360 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.996596 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.996842 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.997072 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.997331 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.997538 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.997716 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.997895 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.998207 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.998394 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.998765 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.998977 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.999343 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.999531 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:14.999899 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.000118 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.000474 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.000685 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.001000 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.001188 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.001492 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.001676 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.001865 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.002072 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.002240 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.002553 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.002721 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.002879 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.003135 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.003301 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.003562 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.003724 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.003913 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.004313 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.004539 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.004813 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.005000 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.005455 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.005588 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.005937 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.006076 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.006304 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.006512 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.006773 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.006970 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.007362 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.007591 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.007817 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.008020 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.008685 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.008878 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.009216 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.009407 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.009673 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.009855 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.010033 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.010327 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.010516 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.010694 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.010919 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.011104 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.011371 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.011576 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.011754 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.012065 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.012322 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.012530 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.012703 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.012904 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.013102 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.013278 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.013473 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.013766 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.013958 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.014281 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.014499 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.014674 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.015003 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.015276 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.015482 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.015892 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.016079 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.016329 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.016581 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.016762 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.016983 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.017158 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.017335 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.017627 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.017830 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.018006 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.018212 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.018406 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.018643 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.018821 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.018999 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.019307 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.019489 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.019683 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.019898 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.020454 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.020454 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.020946 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.021172 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.021419 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.021689 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.021890 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.022065 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.022263 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.022422 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.022764 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.023024 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.023356 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.023542 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.023880 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.024067 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.024461 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.024692 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.025047 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.025525 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.025964 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.026432 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.027030 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.027437 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.027886 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.028213 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.028453 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.028620 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.029046 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.029237 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.029537 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.029757 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.030071 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.030243 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.030645 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.030803 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.031063 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.031247 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.031632 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.031818 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.031993 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.032287 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.032672 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.032860 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.033246 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.033434 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.033776 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.033966 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.034319 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.034507 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.034880 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.035086 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.035451 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.036296 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.036643 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.036835 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.037226 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 16:37:15.037412 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:37:15.037726 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 16:37:15.065733 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6cd744-b068-465f-8ae1-515d27a49c1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:37:15.072508 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG oslo_db.sqlalchemy.engines [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:37:15.300929 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.context [None req-2a6cd744-b068-465f-8ae1-515d27a49c1d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1bef70f7-4921-43b4-a6be-a07489e3d549(cell1) {{(pid=112648) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 16:37:15.307049 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-2a6cd744-b068-465f-8ae1-515d27a49c1d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:37:15.309118 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-2a6cd744-b068-465f-8ae1-515d27a49c1d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:37:15.310032 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-2a6cd744-b068-465f-8ae1-515d27a49c1d None None] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:37:15.312135 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-2a6cd744-b068-465f-8ae1-515d27a49c1d None None] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:37:15.329079 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6cd744-b068-465f-8ae1-515d27a49c1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:37:15.329404 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.context [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1bef70f7-4921-43b4-a6be-a07489e3d549(cell1) {{(pid=112647) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 16:37:15.330015 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6cd744-b068-465f-8ae1-515d27a49c1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:37:15.334201 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG oslo_concurrency.lockutils [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:37:15.336326 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG oslo_concurrency.lockutils [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:37:15.337314 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG oslo_concurrency.lockutils [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:37:15.339532 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG oslo_concurrency.lockutils [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:37:15.353412 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG oslo_db.sqlalchemy.engines [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:37:15.356377 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG oslo_db.sqlalchemy.engines [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:37:15.632458 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6cd744-b068-465f-8ae1-515d27a49c1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:37:15.653570 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG oslo_db.sqlalchemy.engines [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:37:16.024314 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: WARNING keystonemiddleware.auth_token [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 16:37:16.031474 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: WARNING keystonemiddleware.auth_token [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 16:37:16.107436 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: WARNING keystonemiddleware.auth_token [None req-2a6cd744-b068-465f-8ae1-515d27a49c1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 16:37:16.115471 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: WARNING keystonemiddleware.auth_token [None req-2a6cd744-b068-465f-8ae1-515d27a49c1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 16:37:16.444348 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: WARNING keystonemiddleware.auth_token [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 16:37:16.450104 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: WARNING keystonemiddleware.auth_token [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 16:37:16.457194 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b2cd7d9c0 pid: 112647 (default app) Nov 02 16:37:16.460407 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:37:16.461735 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] 10.222.0.118 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.002230 Nov 02 16:37:16.462217 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 1/1] 10.222.0.118 () {50 vars in 793 bytes} [Tue Nov 2 16:37:16 2021] GET /compute/v2.1/ => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:37:16.565672 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: WARNING keystonemiddleware.auth_token [None req-2a6cd744-b068-465f-8ae1-515d27a49c1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 16:37:16.572705 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: WARNING keystonemiddleware.auth_token [None req-2a6cd744-b068-465f-8ae1-515d27a49c1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 16:37:16.579464 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b2cd7d9c0 pid: 112648 (default app) Nov 02 16:38:49.883998 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:38:49.886493 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002949 Nov 02 16:38:49.887617 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 2/2] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:38:49 2021] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:38:50.398987 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-99740b6d-537b-49ad-aa75-380441e074f4 admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:38:50.430830 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-99740b6d-537b-49ad-aa75-380441e074f4 admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.533951 Nov 02 16:38:50.440938 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 1/3] 10.222.0.118 () {60 vars in 1296 bytes} [Tue Nov 2 16:38:49 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:38:52.971826 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:38:52.973209 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-9586c00b-a33a-4a35-a0f2-49748ea543b2 None None] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002777 Nov 02 16:38:52.973657 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 3/4] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:38:52 2021] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:38:53.057493 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-1e1cbc98-3866-4055-a99f-85d7b10a29b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "vcpus": 1, "ram": 256, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:38:53.076891 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:38:53.076891 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: warnings.warn(msg) Nov 02 16:38:53.115526 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-1e1cbc98-3866-4055-a99f-85d7b10a29b2 admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.133187 Nov 02 16:38:53.116338 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 2/5] 10.222.0.118 () {64 vars in 1287 bytes} [Tue Nov 2 16:38:52 2021] POST /compute/v2.1/flavors => generated 409 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:38:53.347455 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-fe49cf7c-c054-4740-adfe-f7186618ca08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:38:53.350132 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:38:53.350132 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: warnings.warn(msg) Nov 02 16:38:53.404348 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-fe49cf7c-c054-4740-adfe-f7186618ca08 admin admin] 10.222.0.118 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.276977 Nov 02 16:38:53.405534 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 4/6] 10.222.0.118 () {64 vars in 1340 bytes} [Tue Nov 2 16:38:53 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:38:55.937732 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-1e1cbc98-3866-4055-a99f-85d7b10a29b2 admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:38:55.939573 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-1e1cbc98-3866-4055-a99f-85d7b10a29b2 admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002418 Nov 02 16:38:55.941045 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 3/7] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:38:55 2021] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:38:56.102702 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-07d94f1b-8d59-45d4-9ff4-55b5da43222b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "swap": 0, "id": "d1", "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:38:56.121338 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:38:56.121338 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: warnings.warn(msg) Nov 02 16:38:56.146530 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-07d94f1b-8d59-45d4-9ff4-55b5da43222b admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.197551 Nov 02 16:38:56.147637 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 5/8] 10.222.0.118 () {64 vars in 1287 bytes} [Tue Nov 2 16:38:55 2021] POST /compute/v2.1/flavors => generated 406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:38:56.162262 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-1dac4cf7-a966-428a-a084-a5fbecf2d4e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:38:56.163993 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:38:56.163993 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: warnings.warn(msg) Nov 02 16:38:56.204670 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-1dac4cf7-a966-428a-a084-a5fbecf2d4e6 admin admin] 10.222.0.118 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047630 Nov 02 16:38:56.206379 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 4/9] 10.222.0.118 () {64 vars in 1340 bytes} [Tue Nov 2 16:38:56 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:38:58.764039 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-07d94f1b-8d59-45d4-9ff4-55b5da43222b admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:38:58.767590 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-07d94f1b-8d59-45d4-9ff4-55b5da43222b admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.004528 Nov 02 16:38:58.769353 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 6/10] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:38:58 2021] GET /compute/v2.1 => generated 389 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:38:58.853057 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-493c2ce2-5c09-4cb3-ad69-f53e8d30cb2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1}} {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:38:58.879552 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-493c2ce2-5c09-4cb3-ad69-f53e8d30cb2b admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.098240 Nov 02 16:38:58.889007 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 5/11] 10.222.0.118 () {64 vars in 1287 bytes} [Tue Nov 2 16:38:58 2021] POST /compute/v2.1/flavors => generated 406 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:38:58.896201 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-20707c65-7eb5-49c4-8fce-8414162123fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:38:58.926325 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-20707c65-7eb5-49c4-8fce-8414162123fc admin admin] 10.222.0.118 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035302 Nov 02 16:38:58.932262 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 7/12] 10.222.0.118 () {64 vars in 1340 bytes} [Tue Nov 2 16:38:58 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:39:01.454861 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-493c2ce2-5c09-4cb3-ad69-f53e8d30cb2b admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:39:01.456667 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-493c2ce2-5c09-4cb3-ad69-f53e8d30cb2b admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002318 Nov 02 16:39:01.457109 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 6/13] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:39:01 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:39:01.526928 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-8bda68a9-a1cf-4c45-98cc-dfd7294fcb33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0, "vcpus": 2}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:01.547984 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-8bda68a9-a1cf-4c45-98cc-dfd7294fcb33 admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.083675 Nov 02 16:39:01.549657 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 8/14] 10.222.0.118 () {64 vars in 1287 bytes} [Tue Nov 2 16:39:01 2021] POST /compute/v2.1/flavors => generated 406 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:39:01.562268 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-6772b44e-9d8e-4ea3-8595-7c7943dc034f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:01.590221 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-6772b44e-9d8e-4ea3-8595-7c7943dc034f admin admin] 10.222.0.118 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031982 Nov 02 16:39:01.591066 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 7/15] 10.222.0.118 () {64 vars in 1340 bytes} [Tue Nov 2 16:39:01 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:39:04.156005 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-8bda68a9-a1cf-4c45-98cc-dfd7294fcb33 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:39:04.157289 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-8bda68a9-a1cf-4c45-98cc-dfd7294fcb33 admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001788 Nov 02 16:39:04.157929 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 9/16] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:39:04 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:39:04.235893 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-c4c689cf-8908-460f-add7-5fcf80bc6ff1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G"}} {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:04.272634 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-c4c689cf-8908-460f-add7-5fcf80bc6ff1 admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.107259 Nov 02 16:39:04.280444 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 8/17] 10.222.0.118 () {64 vars in 1287 bytes} [Tue Nov 2 16:39:04 2021] POST /compute/v2.1/flavors => generated 406 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:39:04.287440 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-d9f4293b-0d38-4ba9-a7bc-95dea6fc4299 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:04.320289 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-d9f4293b-0d38-4ba9-a7bc-95dea6fc4299 admin admin] 10.222.0.118 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037090 Nov 02 16:39:04.320809 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 10/18] 10.222.0.118 () {64 vars in 1340 bytes} [Tue Nov 2 16:39:04 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:39:06.854761 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-c4c689cf-8908-460f-add7-5fcf80bc6ff1 admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:39:06.857267 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-c4c689cf-8908-460f-add7-5fcf80bc6ff1 admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002971 Nov 02 16:39:06.868259 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 9/19] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:39:06 2021] GET /compute/v2.1 => generated 389 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:39:06.952353 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-534311ad-5c7f-4474-9ac7-c8473eee406f admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:39:06.980566 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-534311ad-5c7f-4474-9ac7-c8473eee406f admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.113660 Nov 02 16:39:06.982029 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 11/20] 10.222.0.118 () {60 vars in 1296 bytes} [Tue Nov 2 16:39:06 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:39:09.625088 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-c4c689cf-8908-460f-add7-5fcf80bc6ff1 admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:39:09.626202 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-c4c689cf-8908-460f-add7-5fcf80bc6ff1 admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001734 Nov 02 16:39:09.626651 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 10/21] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:39:09 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:39:09.700118 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-c7cd9437-fca6-4396-a535-f28b3dad907d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "swap": 0, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:09.722007 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-c7cd9437-fca6-4396-a535-f28b3dad907d admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087246 Nov 02 16:39:09.722646 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 12/22] 10.222.0.118 () {64 vars in 1287 bytes} [Tue Nov 2 16:39:09 2021] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:39:09.735997 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-874a4df6-21d8-4751-ae0d-b20c7643dc9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:09.763006 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-874a4df6-21d8-4751-ae0d-b20c7643dc9c admin admin] 10.222.0.118 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031165 Nov 02 16:39:09.763663 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 11/23] 10.222.0.118 () {64 vars in 1337 bytes} [Tue Nov 2 16:39:09 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:39:12.291650 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-c7cd9437-fca6-4396-a535-f28b3dad907d admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:39:12.292792 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-c7cd9437-fca6-4396-a535-f28b3dad907d admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001721 Nov 02 16:39:12.293273 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 13/24] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:39:12 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:39:12.373381 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-f97d583a-f420-4da7-8f58-2136ae3e9274 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "disk": 20, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:12.402101 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-f97d583a-f420-4da7-8f58-2136ae3e9274 admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.100166 Nov 02 16:39:12.402956 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 12/25] 10.222.0.118 () {64 vars in 1287 bytes} [Tue Nov 2 16:39:12 2021] POST /compute/v2.1/flavors => generated 407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:39:12.416699 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-111d32ee-8d49-484f-a3a6-d10a04e43636 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:12.445868 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-111d32ee-8d49-484f-a3a6-d10a04e43636 admin admin] 10.222.0.118 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033248 Nov 02 16:39:12.446537 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 14/26] 10.222.0.118 () {64 vars in 1337 bytes} [Tue Nov 2 16:39:12 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:39:15.060524 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-f97d583a-f420-4da7-8f58-2136ae3e9274 admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:39:15.061629 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-f97d583a-f420-4da7-8f58-2136ae3e9274 admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001725 Nov 02 16:39:15.062355 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 13/27] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:39:15 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:39:15.147207 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-8cbed815-4cf7-49f9-b417-bb673cce0956 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "id": "3", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "ram": 4096}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:15.172638 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-8cbed815-4cf7-49f9-b417-bb673cce0956 admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.102255 Nov 02 16:39:15.173395 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 15/28] 10.222.0.118 () {64 vars in 1287 bytes} [Tue Nov 2 16:39:15 2021] POST /compute/v2.1/flavors => generated 408 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:39:15.187651 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-d4a0959f-4268-4744-8012-93a7d9f8dd5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:15.215070 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-d4a0959f-4268-4744-8012-93a7d9f8dd5d admin admin] 10.222.0.118 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031633 Nov 02 16:39:15.215729 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 14/29] 10.222.0.118 () {64 vars in 1337 bytes} [Tue Nov 2 16:39:15 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:39:17.759788 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-8cbed815-4cf7-49f9-b417-bb673cce0956 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:39:17.761354 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-8cbed815-4cf7-49f9-b417-bb673cce0956 admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002153 Nov 02 16:39:17.762173 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 16/30] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:39:17 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:39:17.850819 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-8aeea769-a6e8-42f8-9471-0d25a40fb8ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "name": "m1.large", "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192}} {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:17.873674 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-8aeea769-a6e8-42f8-9471-0d25a40fb8ad admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103398 Nov 02 16:39:17.874722 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 15/31] 10.222.0.118 () {64 vars in 1287 bytes} [Tue Nov 2 16:39:17 2021] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:39:17.888782 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-2545005d-23eb-4cc7-b7f1-00b195901ce4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:17.916451 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-2545005d-23eb-4cc7-b7f1-00b195901ce4 admin admin] 10.222.0.118 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031959 Nov 02 16:39:17.921640 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 17/32] 10.222.0.118 () {64 vars in 1337 bytes} [Tue Nov 2 16:39:17 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:39:20.494351 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-8aeea769-a6e8-42f8-9471-0d25a40fb8ad admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:39:20.497494 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-8aeea769-a6e8-42f8-9471-0d25a40fb8ad admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.003957 Nov 02 16:39:20.498618 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 16/33] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:39:20 2021] GET /compute/v2.1 => generated 389 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:39:20.583707 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-2f13d15b-6688-4f05-b451-4e06d56d80f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:20.607355 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-2f13d15b-6688-4f05-b451-4e06d56d80f8 admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.094478 Nov 02 16:39:20.608086 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 18/34] 10.222.0.118 () {64 vars in 1287 bytes} [Tue Nov 2 16:39:20 2021] POST /compute/v2.1/flavors => generated 410 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:39:20.621587 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-3b4160cf-cfd9-4ec1-903e-c3fba686af5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:39:20.654355 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-3b4160cf-cfd9-4ec1-903e-c3fba686af5d admin admin] 10.222.0.118 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036642 Nov 02 16:39:20.655076 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 17/35] 10.222.0.118 () {64 vars in 1337 bytes} [Tue Nov 2 16:39:20 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:40:05.967779 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-2f13d15b-6688-4f05-b451-4e06d56d80f8 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:05.968930 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-2f13d15b-6688-4f05-b451-4e06d56d80f8 admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001719 Nov 02 16:40:05.970273 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 19/36] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:40:05 2021] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:40:06.034764 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-4d38d8a1-e794-4b1b-b557-c9c9f8e2b8c0 admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:06.053284 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-4d38d8a1-e794-4b1b-b557-c9c9f8e2b8c0 admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.075408 Nov 02 16:40:06.053877 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 18/37] 10.222.0.118 () {60 vars in 1296 bytes} [Tue Nov 2 16:40:05 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:40:07.654584 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-2f13d15b-6688-4f05-b451-4e06d56d80f8 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:07.655833 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-2f13d15b-6688-4f05-b451-4e06d56d80f8 admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001872 Nov 02 16:40:07.656392 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 20/38] 10.222.0.118 () {56 vars in 1079 bytes} [Tue Nov 2 16:40:07 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:40:07.864326 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-2381803d-fe4a-4bf3-b3f8-b652ba833c1c admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:07.870728 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.wsgi [None req-2381803d-fe4a-4bf3-b3f8-b652ba833c1c admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 16:40:07.871322 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-2381803d-fe4a-4bf3-b3f8-b652ba833c1c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:40:07.872163 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-2381803d-fe4a-4bf3-b3f8-b652ba833c1c admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064570 Nov 02 16:40:07.872762 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 19/39] 10.222.0.118 () {60 vars in 1195 bytes} [Tue Nov 2 16:40:07 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 16:40:07.883421 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-129c33d4-e4c2-48d9-a951-d672033d06ad admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:07.906221 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-129c33d4-e4c2-48d9-a951-d672033d06ad admin admin] 10.222.0.118 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.026657 Nov 02 16:40:07.907660 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 21/40] 10.222.0.118 () {60 vars in 1215 bytes} [Tue Nov 2 16:40:07 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:40:07.918748 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-e003c43d-cb40-4efc-acf2-de494560283f admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:07.941485 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-e003c43d-cb40-4efc-acf2-de494560283f admin admin] 10.222.0.118 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.026556 Nov 02 16:40:07.942122 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 20/41] 10.222.0.118 () {60 vars in 1215 bytes} [Tue Nov 2 16:40:07 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:40:07.955702 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-e123b2d1-5999-408a-8996-aa946d88e494 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:07.964085 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.wsgi [None req-e123b2d1-5999-408a-8996-aa946d88e494 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 16:40:07.964887 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-e123b2d1-5999-408a-8996-aa946d88e494 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:40:07.965900 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-e123b2d1-5999-408a-8996-aa946d88e494 admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015820 Nov 02 16:40:07.966497 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 22/42] 10.222.0.118 () {60 vars in 1195 bytes} [Tue Nov 2 16:40:07 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 16:40:09.478737 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-e003c43d-cb40-4efc-acf2-de494560283f admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:09.479860 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-e003c43d-cb40-4efc-acf2-de494560283f admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001638 Nov 02 16:40:09.480316 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 21/43] 10.222.0.118 () {56 vars in 1079 bytes} [Tue Nov 2 16:40:09 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:40:09.693759 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-74dac78c-5d2a-4139-9a96-d7f738311e25 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:09.699671 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.wsgi [None req-74dac78c-5d2a-4139-9a96-d7f738311e25 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 16:40:09.700760 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-74dac78c-5d2a-4139-9a96-d7f738311e25 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:40:09.701458 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-74dac78c-5d2a-4139-9a96-d7f738311e25 admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068140 Nov 02 16:40:09.702275 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 23/44] 10.222.0.118 () {60 vars in 1195 bytes} [Tue Nov 2 16:40:09 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 16:40:09.714503 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-0969f73e-1d64-4235-bbb4-52dbd33a6aec admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:09.730986 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-0969f73e-1d64-4235-bbb4-52dbd33a6aec admin admin] 10.222.0.118 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.021682 Nov 02 16:40:09.731560 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 22/45] 10.222.0.118 () {60 vars in 1215 bytes} [Tue Nov 2 16:40:09 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:40:09.743295 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-7050f18b-6f15-4518-9082-7b137ec84214 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:09.758631 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-7050f18b-6f15-4518-9082-7b137ec84214 admin admin] 10.222.0.118 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019332 Nov 02 16:40:09.759228 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 24/46] 10.222.0.118 () {60 vars in 1215 bytes} [Tue Nov 2 16:40:09 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:40:09.770184 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-b3eedd44-6098-4a42-97d9-7bed79b33613 admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:09.776024 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.wsgi [None req-b3eedd44-6098-4a42-97d9-7bed79b33613 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 16:40:09.776646 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-b3eedd44-6098-4a42-97d9-7bed79b33613 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:40:09.777449 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-b3eedd44-6098-4a42-97d9-7bed79b33613 admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011211 Nov 02 16:40:09.777964 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 23/47] 10.222.0.118 () {60 vars in 1195 bytes} [Tue Nov 2 16:40:09 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 16:40:11.274671 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-7050f18b-6f15-4518-9082-7b137ec84214 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:11.275791 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-7050f18b-6f15-4518-9082-7b137ec84214 admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001655 Nov 02 16:40:11.276245 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 25/48] 10.222.0.118 () {56 vars in 1079 bytes} [Tue Nov 2 16:40:11 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:40:11.483373 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-d2c50a76-46c9-4ddf-b0aa-6cda0c04232a admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:11.489897 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.wsgi [None req-d2c50a76-46c9-4ddf-b0aa-6cda0c04232a admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 16:40:11.490478 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-d2c50a76-46c9-4ddf-b0aa-6cda0c04232a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:40:11.491294 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-d2c50a76-46c9-4ddf-b0aa-6cda0c04232a admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.065675 Nov 02 16:40:11.491852 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 24/49] 10.222.0.118 () {60 vars in 1198 bytes} [Tue Nov 2 16:40:11 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 16:40:11.502888 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-0fc978f5-373d-4774-83d4-fa2799fa992a admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:11.518189 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-0fc978f5-373d-4774-83d4-fa2799fa992a admin admin] 10.222.0.118 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019811 Nov 02 16:40:11.518755 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 26/50] 10.222.0.118 () {60 vars in 1215 bytes} [Tue Nov 2 16:40:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:40:11.529499 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:11.544584 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] 10.222.0.118 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018790 Nov 02 16:40:11.545153 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 25/51] 10.222.0.118 () {60 vars in 1215 bytes} [Tue Nov 2 16:40:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:40:11.556369 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-66acf371-a3b8-47e9-821f-479d4811b2b2 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:11.562411 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.wsgi [None req-66acf371-a3b8-47e9-821f-479d4811b2b2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 16:40:11.563539 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-66acf371-a3b8-47e9-821f-479d4811b2b2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:40:11.564402 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-66acf371-a3b8-47e9-821f-479d4811b2b2 admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012013 Nov 02 16:40:11.564945 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 27/52] 10.222.0.118 () {60 vars in 1198 bytes} [Tue Nov 2 16:40:11 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 16:40:13.098290 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:13.099850 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002529 Nov 02 16:40:13.100322 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 26/53] 10.222.0.118 () {56 vars in 1079 bytes} [Tue Nov 2 16:40:13 2021] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:40:13.320711 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-36164ad5-7c4b-451b-a2d9-2345bc08be6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:40:13.341930 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-36164ad5-7c4b-451b-a2d9-2345bc08be6d admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.078993 Nov 02 16:40:13.342532 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 28/54] 10.222.0.118 () {64 vars in 1240 bytes} [Tue Nov 2 16:40:13 2021] POST /compute/v2.1/flavors => generated 406 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:40:14.854252 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:14.855342 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001620 Nov 02 16:40:14.855767 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 27/55] 10.222.0.118 () {56 vars in 1079 bytes} [Tue Nov 2 16:40:14 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:40:15.064104 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-24e16916-2499-4540-8cae-30cd5deb73b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:40:15.083378 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-24e16916-2499-4540-8cae-30cd5deb73b4 admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.076380 Nov 02 16:40:15.083972 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 29/56] 10.222.0.118 () {64 vars in 1240 bytes} [Tue Nov 2 16:40:15 2021] POST /compute/v2.1/flavors => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:40:16.610177 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:16.611422 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002494 Nov 02 16:40:16.611863 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 28/57] 10.222.0.118 () {56 vars in 1079 bytes} [Tue Nov 2 16:40:16 2021] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:40:16.822259 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-1882bb5e-cc2f-4913-970e-5ffc184d32c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:40:16.842720 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-1882bb5e-cc2f-4913-970e-5ffc184d32c4 admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.077249 Nov 02 16:40:16.843314 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 30/58] 10.222.0.118 () {64 vars in 1240 bytes} [Tue Nov 2 16:40:16 2021] POST /compute/v2.1/flavors => generated 409 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:40:18.353056 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:18.354147 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001688 Nov 02 16:40:18.354580 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 29/59] 10.222.0.118 () {56 vars in 1079 bytes} [Tue Nov 2 16:40:18 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:40:18.561754 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-c6a59563-156d-4381-8143-1b77b230119b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:40:18.581459 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-c6a59563-156d-4381-8143-1b77b230119b admin admin] 10.222.0.118 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.076272 Nov 02 16:40:18.582060 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 31/60] 10.222.0.118 () {64 vars in 1240 bytes} [Tue Nov 2 16:40:18 2021] POST /compute/v2.1/flavors => generated 411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:40:20.143094 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:20.144209 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001655 Nov 02 16:40:20.144632 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 30/61] 10.222.0.118 () {56 vars in 1079 bytes} [Tue Nov 2 16:40:20 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:40:20.372131 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-3653d9c7-c770-450d-9637-d362f630a8a2 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:40:20.398094 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-3653d9c7-c770-450d-9637-d362f630a8a2 admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.094056 Nov 02 16:40:20.398711 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 32/62] 10.222.0.118 () {60 vars in 1207 bytes} [Tue Nov 2 16:40:20 2021] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:41:10.781705 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:41:10.782782 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-065e9c22-4a3c-4b9a-bf67-262a3593184f admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001691 Nov 02 16:41:10.783211 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 31/63] 10.222.0.118 () {54 vars in 935 bytes} [Tue Nov 2 16:41:10 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:41:10.847661 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-b517d5d8-aa10-4f83-b482-2f11d10f3b19 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:41:10.867959 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-b517d5d8-aa10-4f83-b482-2f11d10f3b19 admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.077580 Nov 02 16:41:10.868582 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 33/64] 10.222.0.118 () {60 vars in 1296 bytes} [Tue Nov 2 16:41:10 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:41:10.893189 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-d88acd98-7897-426c-8c40-6a952a47a0e1 admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:41:10.901728 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-d88acd98-7897-426c-8c40-6a952a47a0e1 admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012910 Nov 02 16:41:10.902274 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 32/65] 10.222.0.118 () {60 vars in 1287 bytes} [Tue Nov 2 16:41:10 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:41:10.915697 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-c17dfc1e-6379-4bca-a31d-7625c8bd354d admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:41:10.924445 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-c17dfc1e-6379-4bca-a31d-7625c8bd354d admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012583 Nov 02 16:41:10.925028 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 34/66] 10.222.0.118 () {60 vars in 1290 bytes} [Tue Nov 2 16:41:10 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:41:10.937685 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-6d812a79-9e07-4117-9cff-eebc7c7e2f9f admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:41:10.946128 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-6d812a79-9e07-4117-9cff-eebc7c7e2f9f admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012371 Nov 02 16:41:10.946693 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 33/67] 10.222.0.118 () {60 vars in 1290 bytes} [Tue Nov 2 16:41:10 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:41:10.959889 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-5b67eb06-a347-469d-82e2-1a17b4ae0678 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:41:10.968917 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-5b67eb06-a347-469d-82e2-1a17b4ae0678 admin admin] 10.222.0.118 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013094 Nov 02 16:41:10.969479 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 35/68] 10.222.0.118 () {60 vars in 1287 bytes} [Tue Nov 2 16:41:10 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:42:39.738497 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-098c15e5-6e39-411d-847f-b225151c9417 tempest-verify_tempest_config-1292685882 tempest-verify_tempest_config-1292685882-project] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:42:39.740661 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-098c15e5-6e39-411d-847f-b225151c9417 tempest-verify_tempest_config-1292685882 tempest-verify_tempest_config-1292685882-project] 10.222.0.118 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.116978 Nov 02 16:42:39.741241 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 34/69] 10.222.0.118 () {58 vars in 1138 bytes} [Tue Nov 2 16:42:39 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:44:14.677569 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-5b67eb06-a347-469d-82e2-1a17b4ae0678 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:44:14.678902 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-5b67eb06-a347-469d-82e2-1a17b4ae0678 admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001736 Nov 02 16:44:14.679920 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 36/70] 10.222.0.118 () {56 vars in 1079 bytes} [Tue Nov 2 16:44:14 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:44:15.105697 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-3831aa9d-be75-43b8-807d-fd9561ab6ad2 admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:44:15.107792 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:44:15.107792 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: warnings.warn(msg) Nov 02 16:44:15.109132 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-3831aa9d-be75-43b8-807d-fd9561ab6ad2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:44:15.109603 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-3831aa9d-be75-43b8-807d-fd9561ab6ad2 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:44:15.110455 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-3831aa9d-be75-43b8-807d-fd9561ab6ad2 admin admin] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:44:15.110889 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-3831aa9d-be75-43b8-807d-fd9561ab6ad2 admin admin] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:44:15.154722 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-3831aa9d-be75-43b8-807d-fd9561ab6ad2 admin admin] 10.222.0.118 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.224442 Nov 02 16:44:15.155400 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 35/71] 10.222.0.118 () {60 vars in 1198 bytes} [Tue Nov 2 16:44:14 2021] GET /compute/v2.1/os-services => generated 791 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:44:16.969243 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-5b67eb06-a347-469d-82e2-1a17b4ae0678 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:44:16.970420 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-5b67eb06-a347-469d-82e2-1a17b4ae0678 admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001855 Nov 02 16:44:16.970979 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 37/72] 10.222.0.118 () {56 vars in 1079 bytes} [Tue Nov 2 16:44:16 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:44:17.237221 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-5c2d3758-29a5-4a9c-97d4-cc757b491253 admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:44:17.238681 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:44:17.238681 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: warnings.warn(msg) Nov 02 16:44:17.240754 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-5c2d3758-29a5-4a9c-97d4-cc757b491253 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:44:17.241221 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-5c2d3758-29a5-4a9c-97d4-cc757b491253 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:44:17.242063 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-5c2d3758-29a5-4a9c-97d4-cc757b491253 admin admin] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:44:17.242503 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-5c2d3758-29a5-4a9c-97d4-cc757b491253 admin admin] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:44:17.266893 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-5c2d3758-29a5-4a9c-97d4-cc757b491253 admin admin] 10.222.0.118 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.125872 Nov 02 16:44:17.267577 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 36/73] 10.222.0.118 () {60 vars in 1198 bytes} [Tue Nov 2 16:44:17 2021] GET /compute/v2.1/os-services => generated 791 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:44:29.549031 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-5b67eb06-a347-469d-82e2-1a17b4ae0678 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:44:29.550190 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-5b67eb06-a347-469d-82e2-1a17b4ae0678 admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001961 Nov 02 16:44:29.550606 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 38/74] 10.222.0.118 () {56 vars in 1079 bytes} [Tue Nov 2 16:44:29 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:44:29.791368 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-16ea861a-3828-4de3-b79f-7ce78bfd4d34 admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:44:29.792801 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:44:29.792801 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: warnings.warn(msg) Nov 02 16:44:29.795064 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-16ea861a-3828-4de3-b79f-7ce78bfd4d34 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:44:29.795688 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-16ea861a-3828-4de3-b79f-7ce78bfd4d34 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:44:29.796765 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-16ea861a-3828-4de3-b79f-7ce78bfd4d34 admin admin] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:44:29.797334 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-16ea861a-3828-4de3-b79f-7ce78bfd4d34 admin admin] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:44:29.827351 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-16ea861a-3828-4de3-b79f-7ce78bfd4d34 admin admin] 10.222.0.118 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.112272 Nov 02 16:44:29.828103 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 37/75] 10.222.0.118 () {60 vars in 1198 bytes} [Tue Nov 2 16:44:29 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:44:31.547865 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: DEBUG nova.api.openstack.wsgi [None req-5b67eb06-a347-469d-82e2-1a17b4ae0678 admin admin] Calling method '>' {{(pid=112647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:44:31.549740 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: INFO nova.api.openstack.requestlog [None req-5b67eb06-a347-469d-82e2-1a17b4ae0678 admin admin] 10.222.0.118 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002382 Nov 02 16:44:31.550489 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: [pid: 112647|app: 0|req: 39/76] 10.222.0.118 () {56 vars in 1079 bytes} [Tue Nov 2 16:44:31 2021] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:44:31.843707 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG nova.api.openstack.wsgi [None req-bf9de5be-23f6-4ba6-b62a-5f00e79853aa admin admin] Calling method '>' {{(pid=112648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:44:31.845167 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:44:31.845167 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: warnings.warn(msg) Nov 02 16:44:31.847224 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-bf9de5be-23f6-4ba6-b62a-5f00e79853aa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:44:31.847733 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-bf9de5be-23f6-4ba6-b62a-5f00e79853aa admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:44:31.848681 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-bf9de5be-23f6-4ba6-b62a-5f00e79853aa admin admin] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:44:31.849244 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: DEBUG oslo_concurrency.lockutils [None req-bf9de5be-23f6-4ba6-b62a-5f00e79853aa admin admin] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:44:31.876940 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: INFO nova.api.openstack.requestlog [None req-bf9de5be-23f6-4ba6-b62a-5f00e79853aa admin admin] 10.222.0.118 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.103959 Nov 02 16:44:31.877613 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: [pid: 112648|app: 0|req: 38/77] 10.222.0.118 () {60 vars in 1198 bytes} [Tue Nov 2 16:44:31 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:45:33.816879 dv-cinder-773876-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 16:45:33.818009 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: Tue Nov 2 16:45:33 2021 - graceful shutdown triggered... Nov 02 16:45:33.818629 dv-cinder-773876-4-iscsi devstack@n-api.service[112647]: Gracefully killing worker 1 (pid: 112647)... Nov 02 16:45:33.819099 dv-cinder-773876-4-iscsi devstack@n-api.service[112648]: Gracefully killing worker 2 (pid: 112648)... Nov 02 16:45:34.819231 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: worker 1 buried after 1 seconds Nov 02 16:45:34.819231 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: worker 2 buried after 1 seconds Nov 02 16:45:34.819231 dv-cinder-773876-4-iscsi devstack@n-api.service[112638]: goodbye to uWSGI. Nov 02 16:45:34.821428 dv-cinder-773876-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 02 16:45:34.822394 dv-cinder-773876-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 16:45:34.826146 dv-cinder-773876-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 16:45:34.837727 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 16:45:34.840935 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 2 16:45:34 2021] *** Nov 02 16:45:34.841159 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 16:45:34.841327 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 16:45:34.841477 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: nodename: dv-cinder-773876-4-iscsi Nov 02 16:45:34.841603 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: machine: x86_64 Nov 02 16:45:34.841732 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: clock source: unix Nov 02 16:45:34.841867 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: pcre jit disabled Nov 02 16:45:34.842021 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: detected number of CPU cores: 4 Nov 02 16:45:34.842157 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: current working directory: / Nov 02 16:45:34.842292 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: detected binary path: /usr/bin/uwsgi-core Nov 02 16:45:34.842574 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: your processes number limit is 47680 Nov 02 16:45:34.842726 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: your memory page size is 4096 bytes Nov 02 16:45:34.842875 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: detected max file descriptor number: 2048 Nov 02 16:45:34.843011 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: lock engine: pthread robust mutexes Nov 02 16:45:34.843378 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: thunder lock: enabled Nov 02 16:45:34.843766 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 16:45:34.844022 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 02 16:45:34.894812 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: Python main interpreter initialized at 0x55e3456b79c0 Nov 02 16:45:34.894812 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: python threads support enabled Nov 02 16:45:34.894812 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: your server socket listen backlog is limited to 100 connections Nov 02 16:45:34.894812 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: your mercy for graceful operations on workers is 90 seconds Nov 02 16:45:34.895401 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 16:45:34.895401 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: *** Operational MODE: preforking *** Nov 02 16:45:34.895732 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: *** uWSGI is running in multiple interpreter mode *** Nov 02 16:45:34.895732 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: spawned uWSGI master process (pid: 127631) Nov 02 16:45:34.896006 dv-cinder-773876-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 16:45:34.896883 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: spawned uWSGI worker 1 (pid: 127648, cores: 1) Nov 02 16:45:34.897553 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: spawned uWSGI worker 2 (pid: 127649, cores: 1) Nov 02 16:45:34.897909 dv-cinder-773876-4-iscsi devstack@n-api.service[127631]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 16:45:36.952831 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 16:45:36.952831 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: from cryptography.utils import int_from_bytes Nov 02 16:45:36.954298 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 16:45:36.954298 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: from cryptography.utils import int_from_bytes Nov 02 16:45:37.002261 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 16:45:37.002261 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: from cryptography.utils import int_from_bytes Nov 02 16:45:37.003154 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 16:45:37.003154 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: from cryptography.utils import int_from_bytes Nov 02 16:45:39.895488 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 16:45:39.896432 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 16:45:39.896432 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 16:45:39.896673 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 16:45:39.896949 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 16:45:39.897366 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.897718 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.898062 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.898403 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.898758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.899093 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.899437 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.899824 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.900202 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.900488 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.900830 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.901179 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773876-4-iscsi {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.901525 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.901856 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.902190 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.902534 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.902860 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.903203 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.903531 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.904061 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.904953 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.905310 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.905630 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.906014 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.906343 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.906683 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.907029 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.907364 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.907717 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.908049 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.908534 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773876-4-iscsi {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.908886 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.909434 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.910723 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.910723 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.910723 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.910723 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.911524 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.911524 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.911907 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.911907 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.912381 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.912666 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.913009 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.913332 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.913663 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.913991 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.914358 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.914659 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.914964 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.915830 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.916082 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.916507 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.916929 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.917286 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.917562 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.917835 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.918180 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.918527 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.918864 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.919194 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.919523 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.919875 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.920222 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.920539 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.920870 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.921199 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.921544 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.921885 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.922234 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.922565 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.922907 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.923334 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.118 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.923611 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.118 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.923940 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.924356 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.924704 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.925031 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.925372 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.925718 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.926053 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.926386 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.926713 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.927058 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.927420 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.928512 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.928512 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.928512 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.929073 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.929073 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.929467 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.929632 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.929912 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.930237 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.930564 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.931489 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.932020 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.932502 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.932835 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.933168 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.933514 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.933838 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.934173 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.934519 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.934858 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.935182 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.935520 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.935843 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.936226 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.936551 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.936883 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.937217 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.937559 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.937889 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.938216 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.938559 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.938892 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.939223 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.939567 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.939885 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.940245 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.940592 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.940924 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.941255 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.941604 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.941910 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.942236 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.942564 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.942890 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.943219 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.943542 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.943887 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.944257 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.944591 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.944923 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.945265 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.945656 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:39.945944 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.946312 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.946759 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.947131 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.947491 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.947843 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.948251 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.948552 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.948890 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.949244 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.949577 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.949912 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.950247 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.950593 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.950934 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.951288 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.951628 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.951971 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.952342 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.952677 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.953020 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.953395 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.953723 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.954057 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.954631 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.955004 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.955343 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.955697 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.956034 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.956422 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.956757 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.957096 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.957434 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.957806 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.958141 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.958477 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.958841 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.959185 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.959529 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.959859 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.960212 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.960540 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.960872 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.961201 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.961550 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.961906 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.962777 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.963200 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.963536 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.963872 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.964235 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.964568 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.964909 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.965244 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.965576 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.965930 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.966262 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.966594 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.966946 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.967289 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.967610 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.968162 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.968527 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.968868 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.969203 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.969558 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.969898 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.970228 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.970590 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.970950 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.971279 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.971633 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.971985 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.972368 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.972697 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.973032 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.973363 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.973693 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.974025 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.974360 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.974815 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.975007 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.975394 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.975673 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.976034 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.976368 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.976705 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.977039 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.977369 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.978449 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.978707 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.979048 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.979425 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.979798 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.980149 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.980527 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.980870 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.981217 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.981556 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.981896 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.982235 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.982576 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.982926 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.983275 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.983610 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.983947 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.984330 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.984671 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.985019 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.985351 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.985693 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.986222 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.986431 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.986783 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.987125 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.987464 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.987804 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.988139 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.988676 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.988863 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.989165 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.989510 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.989852 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.990196 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.990527 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.990878 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.991213 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.991553 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.991883 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.992246 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.992606 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.992968 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.993336 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.993674 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.994021 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.994365 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.994693 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.995029 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.995363 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.995695 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.996031 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.996515 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.996863 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.997201 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.997532 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.997875 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.998211 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.998542 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.998945 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.999209 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.999568 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:39.999910 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.000292 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.000643 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.000976 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.001315 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.001660 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.001996 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.002329 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.002660 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.002991 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.003368 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.003705 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.004037 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.004412 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.004762 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.005099 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.005440 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.005793 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.006096 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.006484 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.006793 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.007286 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.007559 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.007777 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.008111 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.008462 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.008824 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.009425 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.009640 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.009886 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.010324 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.010669 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.011016 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.011947 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.012346 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.012693 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.013041 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.013388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.013733 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.014092 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.014446 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.014788 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.015123 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.015459 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.015789 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.016121 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.016496 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.016832 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.017374 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.017710 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.018050 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.018384 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.018717 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.019097 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.019442 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.019792 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.020128 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.020504 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.020840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.021204 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.021540 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.021871 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.022204 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.022532 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.022907 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.023239 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.023613 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.023968 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.024373 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.025400 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.025868 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.026233 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.026567 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.026907 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.027240 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.027613 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.027915 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.028277 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.028625 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.028963 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.029299 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.029656 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.029965 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.030302 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.030632 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.030980 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.031318 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.031648 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.031974 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.032354 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.032689 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.033020 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.033356 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.033687 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.034032 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.034368 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.034697 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.035028 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.035364 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.035802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.036044 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.037274 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.037274 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.037274 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.038323 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.038690 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.039023 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.039360 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.039706 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.040071 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.041149 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.041735 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.042214 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.042564 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.042902 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.043238 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.043568 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.043904 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.044278 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.044621 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.044947 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.045281 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.045646 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.045984 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.046320 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.046654 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.046984 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.047369 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.047704 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.048152 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.048475 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.048823 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.049174 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.049534 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.050173 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.050596 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.050939 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.051299 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.051652 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.051993 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.052374 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.052709 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.053072 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.053417 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.053758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.054114 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.054463 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.054820 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.055155 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.055497 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.055873 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.056235 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.056581 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.056917 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.057258 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.057598 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.057976 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.058569 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.059020 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.059360 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.059721 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.060049 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.060622 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.060892 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.061230 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.061569 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.061910 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.062246 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.062587 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.062923 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.063408 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.063750 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.064114 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.072840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.072840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.072840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.072840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.072840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.072840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.072840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.072840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.073732 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.073732 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.073732 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.073732 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.073732 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.073732 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.073732 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.073732 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.074388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.074388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.074388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.074388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.074388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.074388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.074388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.074388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.075301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.075301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.075301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.075301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.075301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.075301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.075301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.075301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.076078 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.076078 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.076429 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.076528 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.076873 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.077179 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.077531 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.077876 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.078232 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.078698 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.079049 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.079388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.079745 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.080104 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.080468 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.080800 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.081138 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.081470 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.081802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.082152 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.082485 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.083060 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.083227 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.083479 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.085101 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.085101 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.085101 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.085101 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.085618 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.085618 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.085827 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.086158 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.086866 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.086866 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.087698 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.088022 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.088395 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.088738 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.089231 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.089566 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.089915 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.090279 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.090641 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.090978 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.091343 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.091700 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.092038 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.092521 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.092876 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.093211 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.093545 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.093886 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.094225 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.094559 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.094890 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.095216 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.095561 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.095881 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.096231 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.096599 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.096927 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.097275 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.097612 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.097941 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.098274 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.098609 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.098994 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.099326 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.099690 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.100042 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.100425 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.100791 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.101130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.101483 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.101831 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.102173 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.102516 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.103509 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.104153 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.104610 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.104959 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.105303 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.105651 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.105999 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.106351 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.107006 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.107366 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.107708 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.108048 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.108424 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.108774 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.109117 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.109457 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.109794 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.110129 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.110466 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.110826 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.111180 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.111534 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.111901 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.112278 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.112622 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.112963 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.113304 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.113718 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.114044 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.114378 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.114716 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.115058 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.115400 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.115739 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.116075 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.116444 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.116796 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.117130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.117462 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.117799 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.118137 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.118526 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.118906 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.119256 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.119710 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.120052 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.120430 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.121067 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.121409 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.121771 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.122121 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.122470 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.122816 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.123163 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.123522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.123857 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.124299 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.124638 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.125014 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.125354 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.125704 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.126043 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.126378 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.126725 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.127067 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.127677 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.128065 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.128453 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.128813 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.129167 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.129514 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.129850 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.130207 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.130542 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.130878 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.131221 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.131563 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.131896 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.132262 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.132598 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.133053 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.133264 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.133600 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.134210 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.134503 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.135033 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.135449 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.135789 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.136205 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.136832 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.137190 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.137496 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.137829 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.137942 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 16:45:40.138565 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.139103 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 16:45:40.139327 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.139475 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 16:45:40.139630 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.139774 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 16:45:40.139937 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.140117 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 16:45:40.140310 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.140473 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.140585 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.140749 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.140882 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.141009 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.141117 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.141237 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.141345 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.141453 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.141638 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.141751 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.141869 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.141976 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.142139 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.142315 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.142442 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.142551 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.142656 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.142832 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.142945 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.143115 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.143434 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.143565 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-773876-4-iscsi {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.143687 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.143808 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.143964 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.144127 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.144333 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.144475 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.144618 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.144967 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.145128 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.145294 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.145449 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.145603 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.145744 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.145910 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.146090 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.146375 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.146555 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.146682 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.146803 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.146912 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.147039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.147147 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.147366 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.147599 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.147804 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.147976 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.148240 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.148408 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.148561 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.148748 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.148928 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.149123 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.149337 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.150442 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.150643 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.150808 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.150978 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-773876-4-iscsi {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.151181 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.151356 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.151543 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.151749 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.151749 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.152092 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.152092 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.152397 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.152580 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.152761 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.152920 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.153133 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.153344 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.153514 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.153693 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.153897 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.154109 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.154283 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.154482 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.154642 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.154822 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.154967 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.155141 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.155254 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.155419 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.155611 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.155808 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.155989 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.156135 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.156693 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.156693 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.157396 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.157635 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.157883 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.158167 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.158420 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.158663 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.159883 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.160150 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.160552 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.160724 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.160887 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.161047 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.161219 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.161379 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.161556 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.161754 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.161754 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.162255 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.162450 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.162701 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.162917 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.163144 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.163399 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.163644 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.163918 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.164254 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.164537 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.164726 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.164925 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.165143 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.165892 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.166050 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.166246 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.166388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.166567 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.166913 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.167145 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.167455 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.167620 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.167821 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.168078 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.168355 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.168653 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.168904 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.169163 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.169442 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.169723 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.170003 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.170302 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.170564 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.170846 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.118 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.171129 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.171749 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.118 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.172015 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.172372 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.172627 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.172881 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.173174 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.173441 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.173736 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.174139 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.174139 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.174637 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.174917 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.175178 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.175465 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.175739 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.176002 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.176271 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.176502 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.176502 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.177150 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.177372 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.177835 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.178071 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.178323 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.178555 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.178802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.179036 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.179257 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.179501 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.179727 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.179982 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.180276 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.180517 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.180754 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.181023 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.181279 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.181588 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.181845 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.182123 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.182367 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.182593 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.182593 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.183083 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.183326 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.183595 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.183879 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.184218 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.184476 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.184705 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.184969 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.185196 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.185458 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.185722 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.185968 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.186220 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.186467 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.186706 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.186969 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.187370 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.187636 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.187869 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.188319 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.188580 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.188824 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.189054 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.189313 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.189536 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.189757 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.189982 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 16:45:40.190241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.190241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.190241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.190241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.190241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.190241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.190241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.190241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.192505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.192505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.192505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.192505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.192505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.192505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.192505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.192505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.194465 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.194465 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.194465 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.194465 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.194465 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.194465 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.194465 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.194465 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.196349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.196349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.196349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.196349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 16:45:40.196349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.196349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.196349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.196349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.198029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.198029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.198029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.198029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.198029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.198029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.198029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.198029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.199808 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.199808 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.199808 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.199808 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.199808 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.199808 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.199808 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.199808 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.201330 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.201330 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.201330 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.201330 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.201330 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.201330 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.201330 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.201330 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.202726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.202726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.202726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.202726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.202726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.202726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.202726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.202726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.203889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.203889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.203889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.203889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.203889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.203889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.203889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.203889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.205160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.205160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.205160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.205160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.205160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.205160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.205160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.205160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.206369 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.206369 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.206679 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_db.sqlalchemy.engines [None req-dbb88b74-8546-4a24-8ff0-e74ebe47a077 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:45:40.206847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.206847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.206847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.206847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.206847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.206847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.206847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.206847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.208002 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.208002 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.208002 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.208002 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.208002 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.208757 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.208757 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.209039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.209332 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.209683 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.210036 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.210378 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.210704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.211039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.211369 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.211700 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.212691 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.212928 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.213259 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.213744 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.214138 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.214508 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.214699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.215020 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.215355 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.215683 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.216011 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.216379 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.216760 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.217149 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.217587 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.217806 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.218152 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.218499 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.218837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.219178 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.219513 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.219848 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.220216 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.220538 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.220885 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.221220 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.221563 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.221894 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.222243 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.222576 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.223021 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.223242 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.223581 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.223945 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.224343 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.224688 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.225031 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.225366 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.225704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.226037 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.226373 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.226704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.227034 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.227374 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.228457 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.228950 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.229294 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.229648 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.229985 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.230331 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.230661 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.231000 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.231368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.231728 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.232062 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.232433 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.232777 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.233297 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.233483 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.233762 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.234093 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.235248 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.235594 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.235942 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.236314 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.236660 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.237060 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.237334 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.237671 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.238004 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.238337 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.238682 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.239040 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.239378 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.239892 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.240047 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.240418 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.240748 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.241095 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.241454 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.241754 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.242081 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.242408 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.242788 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.243496 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.243496 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.243827 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.244130 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.244494 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.244834 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.245168 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.246516 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.246516 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.246516 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.246516 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.247159 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.247159 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.247593 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.247765 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.248070 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.248440 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.248756 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.249124 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.249404 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.249739 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.250081 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.250732 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.251084 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.251424 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.251764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.252107 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.252489 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.252842 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.253194 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.253803 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.253803 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.254276 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.254547 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.254804 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.255068 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.255400 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.255724 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.256049 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.256419 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.256778 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.257083 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.257450 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.257778 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.258122 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.258448 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.258780 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.259221 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.259479 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.259806 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.260130 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.260499 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.260821 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.261195 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.261833 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.262159 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.262509 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.262880 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.263205 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.263902 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.263902 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.264642 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.264642 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.265198 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.265198 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.265776 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.265776 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.266210 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.266427 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.266780 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.267048 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.267375 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.267707 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.268047 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.269625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.270271 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.270540 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.270800 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.271069 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.271387 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.271725 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.272075 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.272462 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.272812 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.273150 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.273484 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.274046 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.274234 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.274463 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.275336 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.275701 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.276043 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.276593 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.276944 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.277283 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.277620 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.277951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.278289 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.278800 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.279057 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.279291 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.279600 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.279990 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.280308 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.280565 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.280906 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.281228 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.281559 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.281888 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.282219 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.282542 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.282888 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.283218 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.283550 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.283883 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.284569 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.284569 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.285005 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.285281 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.285612 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.285962 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.286311 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.286647 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.286984 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.287322 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.287652 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.287993 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.288360 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.288701 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.289035 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.289550 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.289717 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.290019 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.290810 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.291172 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.291518 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.291875 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.292229 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.292563 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.294031 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.294031 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.294031 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.294031 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.296626 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.296626 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.296626 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.296626 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.296626 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.296626 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.296626 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.296626 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.299100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.299100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.299100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.299100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.299100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.299100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.299100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.299100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.301477 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.301698 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.context [None req-dbb88b74-8546-4a24-8ff0-e74ebe47a077 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1bef70f7-4921-43b4-a6be-a07489e3d549(cell1) {{(pid=127649) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 16:45:40.301946 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.301946 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.301946 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.301946 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.301946 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.301946 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.301946 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.303632 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.303632 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.303632 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.303632 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.303632 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.304869 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.304869 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.304869 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.306572 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.306850 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dbb88b74-8546-4a24-8ff0-e74ebe47a077 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:45:40.307118 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.307118 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.307118 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.307118 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.308016 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.308278 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dbb88b74-8546-4a24-8ff0-e74ebe47a077 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:45:40.308510 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.308510 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.308831 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dbb88b74-8546-4a24-8ff0-e74ebe47a077 None None] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:45:40.309069 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.309069 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.309331 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.309589 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.309893 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.310184 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.310505 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dbb88b74-8546-4a24-8ff0-e74ebe47a077 None None] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:45:40.310679 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.310846 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.311175 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.311523 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.311963 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.312591 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.312852 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.313197 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.313543 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.313878 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.314346 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.314702 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.315048 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.315399 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.315878 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.316226 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.316568 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.316917 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.317411 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.317753 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.318085 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.318433 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.318766 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.319134 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.319448 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.319787 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.320135 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.320547 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.321104 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.321104 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.321685 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.321937 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.322270 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.322629 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.323058 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.323341 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.323699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.324029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.325437 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.325843 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_db.sqlalchemy.engines [None req-dbb88b74-8546-4a24-8ff0-e74ebe47a077 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:45:40.326332 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.327047 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.327389 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.327717 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_db.sqlalchemy.engines [None req-dbb88b74-8546-4a24-8ff0-e74ebe47a077 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:45:40.327871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.328461 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.328461 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.328796 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.329164 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.329526 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.329865 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.330231 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.330587 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.330919 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.331269 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.331620 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.331949 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.332374 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.332707 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.333055 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.333369 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.333700 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.337670 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.337670 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.337670 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.338136 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.338287 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.338602 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.340368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.340368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.340368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.340368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.340368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.341174 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.341174 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.341357 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.341721 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.341967 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.342280 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.342626 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.342984 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.343334 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.343676 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.344017 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.344419 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.344764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.345111 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.345458 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.345914 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.346233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.346488 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.346813 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.348544 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.349449 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.349449 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.350067 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.350067 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.350841 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.350841 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.350841 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.352090 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.352090 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.352090 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.352090 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.354256 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.354256 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.354256 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.354256 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.354256 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.355625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.355625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.355625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.355625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.357033 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.357033 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.357033 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.357033 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.358912 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.358912 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.358912 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.358912 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.358912 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.358912 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.360133 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.360133 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.360133 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.360133 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.361524 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.361524 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.361524 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.361524 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.362747 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.362747 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.362747 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.363398 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.363398 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.363782 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.363969 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.364222 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.364659 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.365441 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.365441 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.365792 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.366000 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.366264 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.366650 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.367072 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.367389 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.367723 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.368126 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.369106 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.369372 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.369529 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.370076 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.370461 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.370756 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.370936 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.371356 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.371761 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.371975 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.372163 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.372506 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.372883 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.373231 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.373485 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.373821 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.374154 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.374486 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.374838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.375166 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.375497 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.375826 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.376160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.376522 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.376936 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.377232 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.377566 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.377906 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.378231 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.378565 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.378896 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.379229 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.379556 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.379886 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.380237 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.380600 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.380932 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.381256 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.381598 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.382123 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.382469 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.382812 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.383150 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.383541 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.384477 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.385294 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.385687 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.386037 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.386667 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.387034 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.387367 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.387696 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.388031 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.388547 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.388730 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.389421 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.389421 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.389877 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.390124 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.390346 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.390642 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.390980 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.391308 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.391682 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.392029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.392404 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.392743 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.393082 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.393387 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.393727 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.394058 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.394377 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.394699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.395050 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.395385 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.396618 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.397274 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.397748 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.398210 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.398874 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.400331 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.401121 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.401781 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.402296 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.402875 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.403529 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.403961 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.404376 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.404835 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.405208 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.405557 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.405904 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.406251 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.406601 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.406972 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.407497 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.407759 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.408035 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.408419 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.408858 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.409272 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.409566 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.410077 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.410262 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.410932 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.411534 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.411534 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.412388 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.412388 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.412388 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.413112 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.413112 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.413625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.413877 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.414278 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.414632 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.414989 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.416209 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.416591 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.416966 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.417312 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.417776 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.417998 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.418349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.419368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.419368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.419368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.420002 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.420592 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.420592 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.421240 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.421240 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.421710 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.421869 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 16:45:40.422136 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 16:45:40.453367 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_db.sqlalchemy.engines [None req-0bf8d7b9-eeb0-4433-8942-4b95ccbb6a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:45:40.620257 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.context [None req-0bf8d7b9-eeb0-4433-8942-4b95ccbb6a72 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1bef70f7-4921-43b4-a6be-a07489e3d549(cell1) {{(pid=127648) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 16:45:40.629426 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0bf8d7b9-eeb0-4433-8942-4b95ccbb6a72 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:45:40.632807 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0bf8d7b9-eeb0-4433-8942-4b95ccbb6a72 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:45:40.635101 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0bf8d7b9-eeb0-4433-8942-4b95ccbb6a72 None None] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:45:40.640989 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0bf8d7b9-eeb0-4433-8942-4b95ccbb6a72 None None] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:45:40.663872 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_db.sqlalchemy.engines [None req-0bf8d7b9-eeb0-4433-8942-4b95ccbb6a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:45:40.666719 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_db.sqlalchemy.engines [None req-0bf8d7b9-eeb0-4433-8942-4b95ccbb6a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:45:40.782091 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_db.sqlalchemy.engines [None req-dbb88b74-8546-4a24-8ff0-e74ebe47a077 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:45:41.078764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_db.sqlalchemy.engines [None req-0bf8d7b9-eeb0-4433-8942-4b95ccbb6a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 16:45:41.251846 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: WARNING keystonemiddleware.auth_token [None req-dbb88b74-8546-4a24-8ff0-e74ebe47a077 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 16:45:41.270623 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: WARNING keystonemiddleware.auth_token [None req-dbb88b74-8546-4a24-8ff0-e74ebe47a077 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 16:45:41.500819 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: WARNING keystonemiddleware.auth_token [None req-0bf8d7b9-eeb0-4433-8942-4b95ccbb6a72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 16:45:41.508878 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: WARNING keystonemiddleware.auth_token [None req-0bf8d7b9-eeb0-4433-8942-4b95ccbb6a72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 16:45:41.730105 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: WARNING keystonemiddleware.auth_token [None req-dbb88b74-8546-4a24-8ff0-e74ebe47a077 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 16:45:41.739711 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: WARNING keystonemiddleware.auth_token [None req-dbb88b74-8546-4a24-8ff0-e74ebe47a077 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 16:45:41.747240 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e3456b79c0 pid: 127649 (default app) Nov 02 16:45:41.939930 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: WARNING keystonemiddleware.auth_token [None req-0bf8d7b9-eeb0-4433-8942-4b95ccbb6a72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 16:45:41.946233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: WARNING keystonemiddleware.auth_token [None req-0bf8d7b9-eeb0-4433-8942-4b95ccbb6a72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 16:45:41.953291 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e3456b79c0 pid: 127648 (default app) Nov 02 16:46:23.633538 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2009715426", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "networks": [{"uuid": "716d1add-eeb0-4090-99a3-8e93ac4c3a42"}]}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:46:24.602095 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1434688789", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "networks": [{"uuid": "244687ba-bf2c-4a2d-aed3-980547dbf6c6"}]}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:46:24.717998 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.network.neutron [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] validate_networks() for [('716d1add-eeb0-4090-99a3-8e93ac4c3a42', None, None, None, None, None)] {{(pid=127649) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:46:25.386913 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.network.neutron [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] validate_networks() for [('244687ba-bf2c-4a2d-aed3-980547dbf6c6', None, None, None, None, None)] {{(pid=127648) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:46:29.609022 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Flavor limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:46:29.610033 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Image limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:46:29.610033 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Flavor pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:46:29.613081 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Image pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:46:29.613883 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:46:29.668983 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:29.673542 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:29.676521 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:29.680937 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:29.719240 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Flavor limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:46:29.720007 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Image limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:46:29.720429 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Flavor pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:46:29.721761 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Image pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:46:29.722308 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:46:29.772816 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:29.777493 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:29.783606 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:29.784195 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:29.798058 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Getting quotas for project e3895ec42d70403e8667ea0b09eb9ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:46:29.827505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Getting quotas for user 436329e99f8e421ab41666884f7888d8 and project e3895ec42d70403e8667ea0b09eb9ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:46:29.869194 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Getting quotas for project fd124bfe873f4553b53c6d8282df462c. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:46:29.890511 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Getting quotas for user 3f09374d85e441bea89376debca253d9 and project fd124bfe873f4553b53c6d8282df462c. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:46:29.901068 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Going to run 1 instances... {{(pid=127648) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:46:29.919099 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:46:29.926770 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Going to run 1 instances... {{(pid=127649) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:46:29.935672 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:46:30.244591 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-d55db4b3-2f11-464c-a1c5-2fa08121849f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 7.965017 Nov 02 16:46:30.251238 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 1/1] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:46:22 2021] POST /compute/v2.1/servers => generated 382 bytes in 7982 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:46:30.285116 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e4b15f7c-d8af-4acf-b467-1162507af513 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:30.290470 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e4b15f7c-d8af-4acf-b467-1162507af513 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:30.330555 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7d11d1af-a375-4f15-a961-3cc016b87ced tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 6.462733 Nov 02 16:46:30.345570 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 1/2] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:46:23 2021] POST /compute/v2.1/servers => generated 382 bytes in 6481 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:46:30.394205 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-fb3ba205-894a-4fd7-9134-e83b54f9dbfb tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:30.395866 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-fb3ba205-894a-4fd7-9134-e83b54f9dbfb tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:30.700113 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-fb3ba205-894a-4fd7-9134-e83b54f9dbfb tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:30.756217 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-fb3ba205-894a-4fd7-9134-e83b54f9dbfb tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1219 microversion: 2.1 time: 0.397264 Nov 02 16:46:30.773903 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 2/3] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:30 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1219 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:31.172345 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e4b15f7c-d8af-4acf-b467-1162507af513 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:31.212245 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e4b15f7c-d8af-4acf-b467-1162507af513 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1222 microversion: 2.1 time: 0.942065 Nov 02 16:46:31.216258 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 2/4] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:30 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1222 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:31.785524 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bce05142-4291-4237-a3e8-6725e4e1296d tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:31.786606 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-bce05142-4291-4237-a3e8-6725e4e1296d tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:32.121740 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-bce05142-4291-4237-a3e8-6725e4e1296d tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:32.151980 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-bce05142-4291-4237-a3e8-6725e4e1296d tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1219 microversion: 2.1 time: 0.371142 Nov 02 16:46:32.169002 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 3/5] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:31 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1219 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:32.240580 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fd76830c-56e6-406c-af8f-f61fea463f54 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:32.242443 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fd76830c-56e6-406c-af8f-f61fea463f54 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:32.477678 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-fd76830c-56e6-406c-af8f-f61fea463f54 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:32.514204 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fd76830c-56e6-406c-af8f-f61fea463f54 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1222 microversion: 2.1 time: 0.269886 Nov 02 16:46:32.539890 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 4/6] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:32 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1222 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:46:32.605737 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-572607370", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e13a8a17-03ff-45d6-87c8-8e4368446fe7"}]}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:46:32.857865 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.network.neutron [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] validate_networks() for [('e13a8a17-03ff-45d6-87c8-8e4368446fe7', None, None, None, None, None)] {{(pid=127648) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:46:33.187948 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-58e143c7-897a-41c6-a037-e1fca28c18be tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:33.188956 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-58e143c7-897a-41c6-a037-e1fca28c18be tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:33.467562 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-58e143c7-897a-41c6-a037-e1fca28c18be tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:33.491502 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-58e143c7-897a-41c6-a037-e1fca28c18be tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1219 microversion: 2.1 time: 0.307159 Nov 02 16:46:33.493752 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 5/7] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:33 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1219 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:46:33.552043 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f0168f4c-6435-4954-84f9-5fd07ce418f1 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:33.557184 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f0168f4c-6435-4954-84f9-5fd07ce418f1 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:34.037351 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f0168f4c-6435-4954-84f9-5fd07ce418f1 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:34.050365 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f0168f4c-6435-4954-84f9-5fd07ce418f1 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1222 microversion: 2.1 time: 0.513663 Nov 02 16:46:34.068016 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 6/8] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:33 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1222 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:34.513490 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c191f307-af9a-40ff-a215-264aa36433e0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:34.515589 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c191f307-af9a-40ff-a215-264aa36433e0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:34.532069 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c191f307-af9a-40ff-a215-264aa36433e0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:34.556698 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c191f307-af9a-40ff-a215-264aa36433e0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:34.557607 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c191f307-af9a-40ff-a215-264aa36433e0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:34.560053 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c191f307-af9a-40ff-a215-264aa36433e0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:34.653099 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Flavor limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:46:34.654406 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Image limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:46:34.654406 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Flavor pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:46:34.654876 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Image pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:46:34.655286 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:46:34.679498 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:34.679750 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:34.680633 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:34.681092 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:34.742331 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Getting quotas for project 7a412769a7274d9da389f724f6f4744e. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:46:34.753993 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Getting quotas for user 3b985f6d342a49579d3afd603881498c and project 7a412769a7274d9da389f724f6f4744e. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:46:34.802021 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Going to run 1 instances... {{(pid=127648) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:46:34.815175 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:46:34.969701 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-29bc7d2a-2d6c-4c2c-be50-e63f365f985b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 3.774060 Nov 02 16:46:34.975406 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 3/9] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:46:31 2021] POST /compute/v2.1/servers => generated 385 bytes in 3781 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:46:34.998698 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9d8e28f2-9d69-4a58-b8c8-7db56dbcf816 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:34.999437 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9d8e28f2-9d69-4a58-b8c8-7db56dbcf816 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:35.123493 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9d8e28f2-9d69-4a58-b8c8-7db56dbcf816 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:35.135550 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9d8e28f2-9d69-4a58-b8c8-7db56dbcf816 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1225 microversion: 2.1 time: 0.151837 Nov 02 16:46:35.136951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 4/10] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:34 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1225 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:35.152260 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-aa29b5fe-8ee5-47c4-9190-19bdd518ea6c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:35.153042 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-aa29b5fe-8ee5-47c4-9190-19bdd518ea6c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:35.168871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aa29b5fe-8ee5-47c4-9190-19bdd518ea6c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:35.169854 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aa29b5fe-8ee5-47c4-9190-19bdd518ea6c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:35.170778 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aa29b5fe-8ee5-47c4-9190-19bdd518ea6c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:35.171286 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aa29b5fe-8ee5-47c4-9190-19bdd518ea6c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:35.622018 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-aa29b5fe-8ee5-47c4-9190-19bdd518ea6c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:35.681368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-aa29b5fe-8ee5-47c4-9190-19bdd518ea6c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1218 microversion: 2.1 time: 0.542830 Nov 02 16:46:35.690294 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 5/11] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:35 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1218 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:35.770223 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-138026020", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e13a8a17-03ff-45d6-87c8-8e4368446fe7"}]}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:46:35.792226 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c191f307-af9a-40ff-a215-264aa36433e0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:35.845155 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c191f307-af9a-40ff-a215-264aa36433e0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1215 microversion: 2.1 time: 1.330277 Nov 02 16:46:35.848033 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 7/12] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:34 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1215 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:46:36.021636 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.network.neutron [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] validate_networks() for [('e13a8a17-03ff-45d6-87c8-8e4368446fe7', None, None, None, None, None)] {{(pid=127648) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:46:36.717842 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-622e27c7-d57e-4548-abe1-0b41ce8877e4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:36.724129 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-622e27c7-d57e-4548-abe1-0b41ce8877e4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:36.822651 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-622e27c7-d57e-4548-abe1-0b41ce8877e4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:36.823557 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-622e27c7-d57e-4548-abe1-0b41ce8877e4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:36.832408 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-622e27c7-d57e-4548-abe1-0b41ce8877e4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:36.842143 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-622e27c7-d57e-4548-abe1-0b41ce8877e4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:37.225307 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-622e27c7-d57e-4548-abe1-0b41ce8877e4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:37.236586 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-622e27c7-d57e-4548-abe1-0b41ce8877e4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1274 microversion: 2.1 time: 0.532344 Nov 02 16:46:37.246125 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 8/13] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:36 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1274 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:37.251023 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e676230e-abb9-48fe-a25b-07ce2944eb8e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:37.266375 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e676230e-abb9-48fe-a25b-07ce2944eb8e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:37.301366 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e676230e-abb9-48fe-a25b-07ce2944eb8e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:37.302450 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e676230e-abb9-48fe-a25b-07ce2944eb8e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:37.303742 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e676230e-abb9-48fe-a25b-07ce2944eb8e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:37.313318 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e676230e-abb9-48fe-a25b-07ce2944eb8e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:37.781330 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e676230e-abb9-48fe-a25b-07ce2944eb8e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:37.810090 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e676230e-abb9-48fe-a25b-07ce2944eb8e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1277 microversion: 2.1 time: 0.563852 Nov 02 16:46:37.818933 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 9/14] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:37 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1277 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:38.283641 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fc8226c1-1318-418e-8639-769cb22e7ce5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:38.284569 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fc8226c1-1318-418e-8639-769cb22e7ce5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:38.334894 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc8226c1-1318-418e-8639-769cb22e7ce5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:38.342830 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc8226c1-1318-418e-8639-769cb22e7ce5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:38.343916 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc8226c1-1318-418e-8639-769cb22e7ce5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:38.345084 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc8226c1-1318-418e-8639-769cb22e7ce5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:38.930178 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-fc8226c1-1318-418e-8639-769cb22e7ce5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:38.978232 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fc8226c1-1318-418e-8639-769cb22e7ce5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1280 microversion: 2.1 time: 0.714411 Nov 02 16:46:39.002052 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 10/15] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:38 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1280 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:46:39.021474 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7b261b12-50c9-40ce-8046-71b58aac1bf4 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:39.023187 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7b261b12-50c9-40ce-8046-71b58aac1bf4 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:39.049164 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7b261b12-50c9-40ce-8046-71b58aac1bf4 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:39.050308 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7b261b12-50c9-40ce-8046-71b58aac1bf4 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:39.057449 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7b261b12-50c9-40ce-8046-71b58aac1bf4 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:39.059973 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7b261b12-50c9-40ce-8046-71b58aac1bf4 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:39.948683 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7b261b12-50c9-40ce-8046-71b58aac1bf4 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:39.978139 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7b261b12-50c9-40ce-8046-71b58aac1bf4 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1277 microversion: 2.1 time: 0.969811 Nov 02 16:46:39.979127 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 11/16] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:39 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1277 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:40.010443 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ea1e35b3-7a2c-4318-b9d1-5a07bb911ad7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:40.011698 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ea1e35b3-7a2c-4318-b9d1-5a07bb911ad7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:40.038577 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ea1e35b3-7a2c-4318-b9d1-5a07bb911ad7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:40.039043 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ea1e35b3-7a2c-4318-b9d1-5a07bb911ad7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:40.040142 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ea1e35b3-7a2c-4318-b9d1-5a07bb911ad7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:40.040807 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ea1e35b3-7a2c-4318-b9d1-5a07bb911ad7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:40.438368 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ea1e35b3-7a2c-4318-b9d1-5a07bb911ad7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:40.467928 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ea1e35b3-7a2c-4318-b9d1-5a07bb911ad7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1280 microversion: 2.1 time: 0.461445 Nov 02 16:46:40.479912 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 12/17] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:40 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1280 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:40.746563 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Flavor limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:46:40.747411 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Image limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:46:40.748538 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Flavor pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:46:40.749274 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Image pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:46:40.750079 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:46:40.813315 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:40.816368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:40.817646 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:40.824096 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:40.894164 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Getting quotas for project 7a412769a7274d9da389f724f6f4744e. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:46:40.905053 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Getting quotas for user 3b985f6d342a49579d3afd603881498c and project 7a412769a7274d9da389f724f6f4744e. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:46:40.994203 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Going to run 1 instances... {{(pid=127648) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:46:41.016044 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5563019b-ca69-4ce8-abab-3cabcff558e9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:41.017831 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5563019b-ca69-4ce8-abab-3cabcff558e9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:41.023751 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:46:41.040239 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5563019b-ca69-4ce8-abab-3cabcff558e9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:41.044780 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5563019b-ca69-4ce8-abab-3cabcff558e9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:41.049506 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5563019b-ca69-4ce8-abab-3cabcff558e9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:41.056657 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5563019b-ca69-4ce8-abab-3cabcff558e9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:41.196935 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6f0f9f48-b165-4e95-b170-9fc979858e98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 5.436412 Nov 02 16:46:41.199604 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 6/18] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:46:35 2021] POST /compute/v2.1/servers => generated 385 bytes in 5440 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 16:46:41.224515 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2d296292-5f14-4ab0-8796-6d25b684e80a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:41.226868 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2d296292-5f14-4ab0-8796-6d25b684e80a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:42.347089 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5563019b-ca69-4ce8-abab-3cabcff558e9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:42.374773 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5563019b-ca69-4ce8-abab-3cabcff558e9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1277 microversion: 2.1 time: 1.366164 Nov 02 16:46:42.380677 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 13/19] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:41 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1277 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:42.397606 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-58239265-24b8-4b83-8a02-b6f3682329f0 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:42.398716 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-58239265-24b8-4b83-8a02-b6f3682329f0 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:42.431707 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-58239265-24b8-4b83-8a02-b6f3682329f0 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:42.437768 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-58239265-24b8-4b83-8a02-b6f3682329f0 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:42.441617 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-58239265-24b8-4b83-8a02-b6f3682329f0 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:42.442371 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-58239265-24b8-4b83-8a02-b6f3682329f0 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:42.630697 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2d296292-5f14-4ab0-8796-6d25b684e80a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:42.644510 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2d296292-5f14-4ab0-8796-6d25b684e80a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1225 microversion: 2.1 time: 1.437285 Nov 02 16:46:42.653365 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 7/20] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:41 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1225 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:42.781471 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-58239265-24b8-4b83-8a02-b6f3682329f0 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:42.809398 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-58239265-24b8-4b83-8a02-b6f3682329f0 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1280 microversion: 2.1 time: 0.420340 Nov 02 16:46:42.812319 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 14/21] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:42 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1280 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:43.419123 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-17c047ec-f369-4661-a2a3-b301a0c77137 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:43.420749 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-17c047ec-f369-4661-a2a3-b301a0c77137 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:43.454737 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-17c047ec-f369-4661-a2a3-b301a0c77137 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:43.458827 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-17c047ec-f369-4661-a2a3-b301a0c77137 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:43.462570 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-17c047ec-f369-4661-a2a3-b301a0c77137 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:43.465835 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-17c047ec-f369-4661-a2a3-b301a0c77137 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:43.671120 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3b5e340e-8f3f-454d-b663-55b1320e9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:43.672974 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3b5e340e-8f3f-454d-b663-55b1320e9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:43.696842 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3b5e340e-8f3f-454d-b663-55b1320e9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:43.700142 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3b5e340e-8f3f-454d-b663-55b1320e9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:43.701575 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3b5e340e-8f3f-454d-b663-55b1320e9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:43.702314 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3b5e340e-8f3f-454d-b663-55b1320e9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:43.932046 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-17c047ec-f369-4661-a2a3-b301a0c77137 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:44.003962 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-17c047ec-f369-4661-a2a3-b301a0c77137 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1277 microversion: 2.1 time: 0.593833 Nov 02 16:46:44.009345 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 8/22] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:43 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1277 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:44.036220 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3b5e340e-8f3f-454d-b663-55b1320e9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:44.074997 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7a643728-2b6c-489b-83de-5d7096ebdacd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:44.074997 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7a643728-2b6c-489b-83de-5d7096ebdacd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:44.100072 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7a643728-2b6c-489b-83de-5d7096ebdacd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:44.104560 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7a643728-2b6c-489b-83de-5d7096ebdacd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:44.104889 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3b5e340e-8f3f-454d-b663-55b1320e9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1277 microversion: 2.1 time: 0.437506 Nov 02 16:46:44.105496 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 15/23] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:43 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1277 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:46:44.110571 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7a643728-2b6c-489b-83de-5d7096ebdacd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:44.112573 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7a643728-2b6c-489b-83de-5d7096ebdacd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:44.687545 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7a643728-2b6c-489b-83de-5d7096ebdacd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:44.720199 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7a643728-2b6c-489b-83de-5d7096ebdacd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.689257 Nov 02 16:46:44.720199 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 9/24] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:44 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:45.050941 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f27953fe-818b-448a-b2db-c6be4348b0f9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:45.051698 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f27953fe-818b-448a-b2db-c6be4348b0f9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:45.090996 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f27953fe-818b-448a-b2db-c6be4348b0f9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:45.098192 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f27953fe-818b-448a-b2db-c6be4348b0f9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:45.109474 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f27953fe-818b-448a-b2db-c6be4348b0f9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:45.110257 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f27953fe-818b-448a-b2db-c6be4348b0f9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:45.132325 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d3aee774-12b6-445c-8d19-8320598f5bf6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:45.132940 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d3aee774-12b6-445c-8d19-8320598f5bf6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:45.169416 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d3aee774-12b6-445c-8d19-8320598f5bf6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:45.172955 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d3aee774-12b6-445c-8d19-8320598f5bf6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:45.180746 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d3aee774-12b6-445c-8d19-8320598f5bf6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:45.185344 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d3aee774-12b6-445c-8d19-8320598f5bf6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:45.367598 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d3aee774-12b6-445c-8d19-8320598f5bf6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:45.393833 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d3aee774-12b6-445c-8d19-8320598f5bf6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1277 microversion: 2.1 time: 0.268419 Nov 02 16:46:45.395134 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 10/25] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:45 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1277 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:46:45.735721 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a9b88084-960e-47a4-8fed-b0bbe2d1acd4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:45.736677 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a9b88084-960e-47a4-8fed-b0bbe2d1acd4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:45.753479 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a9b88084-960e-47a4-8fed-b0bbe2d1acd4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:45.754450 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a9b88084-960e-47a4-8fed-b0bbe2d1acd4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:45.755571 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a9b88084-960e-47a4-8fed-b0bbe2d1acd4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:45.756929 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a9b88084-960e-47a4-8fed-b0bbe2d1acd4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:45.945794 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f27953fe-818b-448a-b2db-c6be4348b0f9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:45.956685 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f27953fe-818b-448a-b2db-c6be4348b0f9 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.920150 Nov 02 16:46:45.957760 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 16/26] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:45 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:46.413704 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-28652822-2665-4eb0-9a14-463e314bd27b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:46.415165 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-28652822-2665-4eb0-9a14-463e314bd27b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:46.428782 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-28652822-2665-4eb0-9a14-463e314bd27b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:46.429476 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-28652822-2665-4eb0-9a14-463e314bd27b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:46.430403 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-28652822-2665-4eb0-9a14-463e314bd27b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:46.430866 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-28652822-2665-4eb0-9a14-463e314bd27b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:46.717886 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-28652822-2665-4eb0-9a14-463e314bd27b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:46.750982 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-28652822-2665-4eb0-9a14-463e314bd27b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1277 microversion: 2.1 time: 0.341846 Nov 02 16:46:46.751970 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 17/27] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:46 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1277 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:46.808668 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a9b88084-960e-47a4-8fed-b0bbe2d1acd4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:46.823028 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a9b88084-960e-47a4-8fed-b0bbe2d1acd4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 1.091309 Nov 02 16:46:46.824294 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 11/28] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:45 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:46:46.996454 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3bce2d97-0818-4313-b8f4-679ee9de65d0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:46.997167 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3bce2d97-0818-4313-b8f4-679ee9de65d0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:47.011717 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3bce2d97-0818-4313-b8f4-679ee9de65d0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:47.019404 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3bce2d97-0818-4313-b8f4-679ee9de65d0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:47.021346 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3bce2d97-0818-4313-b8f4-679ee9de65d0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:47.022213 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3bce2d97-0818-4313-b8f4-679ee9de65d0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:47.794290 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-dd9db25b-a758-481f-a67a-512b503d231c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:47.797622 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-dd9db25b-a758-481f-a67a-512b503d231c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:47.884509 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dd9db25b-a758-481f-a67a-512b503d231c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:47.885610 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dd9db25b-a758-481f-a67a-512b503d231c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:47.886731 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dd9db25b-a758-481f-a67a-512b503d231c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:47.887334 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dd9db25b-a758-481f-a67a-512b503d231c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:48.405059 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-dd9db25b-a758-481f-a67a-512b503d231c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:48.419049 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-dd9db25b-a758-481f-a67a-512b503d231c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1283 microversion: 2.1 time: 0.651696 Nov 02 16:46:48.432588 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 12/29] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:47 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1283 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:48.450882 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-916a0297-74f8-4029-857c-710a06dda3d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:48.473774 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-916a0297-74f8-4029-857c-710a06dda3d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:48.538843 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-916a0297-74f8-4029-857c-710a06dda3d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:48.548012 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-916a0297-74f8-4029-857c-710a06dda3d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:48.553090 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-916a0297-74f8-4029-857c-710a06dda3d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:48.557284 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-916a0297-74f8-4029-857c-710a06dda3d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:50.598223 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3bce2d97-0818-4313-b8f4-679ee9de65d0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:50.608908 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3bce2d97-0818-4313-b8f4-679ee9de65d0 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 3.623638 Nov 02 16:46:50.610876 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 18/30] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:46 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 3627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:50.621760 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-85aaaa48-bad6-46e8-8886-50c7b0fd2bb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:50.629170 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-85aaaa48-bad6-46e8-8886-50c7b0fd2bb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:50.676488 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-85aaaa48-bad6-46e8-8886-50c7b0fd2bb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:50.676963 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-85aaaa48-bad6-46e8-8886-50c7b0fd2bb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:50.683366 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-85aaaa48-bad6-46e8-8886-50c7b0fd2bb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:50.686680 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-85aaaa48-bad6-46e8-8886-50c7b0fd2bb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:51.070675 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-85aaaa48-bad6-46e8-8886-50c7b0fd2bb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:51.151087 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-85aaaa48-bad6-46e8-8886-50c7b0fd2bb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1283 microversion: 2.1 time: 0.534523 Nov 02 16:46:51.158082 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 19/31] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:50 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1283 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:51.360644 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-916a0297-74f8-4029-857c-710a06dda3d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:51.387293 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-916a0297-74f8-4029-857c-710a06dda3d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 2.949226 Nov 02 16:46:51.392235 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 13/32] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:48 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 2957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:51.633498 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-858df616-2b70-46a9-bf02-e9d396e02f71 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:51.635156 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-858df616-2b70-46a9-bf02-e9d396e02f71 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:51.683270 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-858df616-2b70-46a9-bf02-e9d396e02f71 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:51.696431 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-858df616-2b70-46a9-bf02-e9d396e02f71 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:51.697596 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-858df616-2b70-46a9-bf02-e9d396e02f71 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:51.702081 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-858df616-2b70-46a9-bf02-e9d396e02f71 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:52.470370 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-858df616-2b70-46a9-bf02-e9d396e02f71 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:52.488137 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-858df616-2b70-46a9-bf02-e9d396e02f71 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.862479 Nov 02 16:46:52.500650 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 20/33] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:51 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:52.507295 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5b45072b-2921-4cea-bf33-403d055826d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:52.508455 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5b45072b-2921-4cea-bf33-403d055826d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:52.533641 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5b45072b-2921-4cea-bf33-403d055826d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:52.534169 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5b45072b-2921-4cea-bf33-403d055826d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:52.535150 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5b45072b-2921-4cea-bf33-403d055826d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:52.535647 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5b45072b-2921-4cea-bf33-403d055826d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:52.625134 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6f8acea0-cc0f-44ed-b4f7-64d5fb22d31f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'create', calling method: .version_select at 0x7f11341efd30>, body: {"keypair": {"name": "tempest-keypair-1875712050"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:46:52.749108 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5b45072b-2921-4cea-bf33-403d055826d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:52.779942 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5b45072b-2921-4cea-bf33-403d055826d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1283 microversion: 2.1 time: 0.276869 Nov 02 16:46:52.781648 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 21/34] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:52 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1283 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:52.799638 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0b6ed7a0-0968-4852-a2ee-3c78e3207881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:52.811172 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0b6ed7a0-0968-4852-a2ee-3c78e3207881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:52.844672 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b6ed7a0-0968-4852-a2ee-3c78e3207881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:52.845167 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b6ed7a0-0968-4852-a2ee-3c78e3207881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:52.846135 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b6ed7a0-0968-4852-a2ee-3c78e3207881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:52.846526 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b6ed7a0-0968-4852-a2ee-3c78e3207881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:52.871559 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-6f8acea0-cc0f-44ed-b4f7-64d5fb22d31f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Getting quotas for project a575c6bd2e574ad19dc299cc1df253f3. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:46:52.902818 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-6f8acea0-cc0f-44ed-b4f7-64d5fb22d31f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Getting quotas for user 821a58487d5b4087bac538d532382aef and project a575c6bd2e574ad19dc299cc1df253f3. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:46:53.832457 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-6f8acea0-cc0f-44ed-b4f7-64d5fb22d31f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Getting quotas for project a575c6bd2e574ad19dc299cc1df253f3. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:46:53.861036 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-6f8acea0-cc0f-44ed-b4f7-64d5fb22d31f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Getting quotas for user 821a58487d5b4087bac538d532382aef and project a575c6bd2e574ad19dc299cc1df253f3. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:46:53.909759 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0b6ed7a0-0968-4852-a2ee-3c78e3207881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:53.937128 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6f8acea0-cc0f-44ed-b4f7-64d5fb22d31f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.812595 Nov 02 16:46:53.953759 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0b6ed7a0-0968-4852-a2ee-3c78e3207881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 1.168315 Nov 02 16:46:53.954661 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 14/35] 10.222.0.118 () {60 vars in 1162 bytes} [Tue Nov 2 16:46:52 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:46:53.994810 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 22/36] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:52 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:54.046320 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9efe5d83-a120-45a1-aeb6-e30bfe9788b1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:54.047317 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9efe5d83-a120-45a1-aeb6-e30bfe9788b1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:54.096025 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9efe5d83-a120-45a1-aeb6-e30bfe9788b1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:54.097392 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9efe5d83-a120-45a1-aeb6-e30bfe9788b1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:54.102112 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9efe5d83-a120-45a1-aeb6-e30bfe9788b1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:54.106096 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9efe5d83-a120-45a1-aeb6-e30bfe9788b1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:54.250871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-22d17dd8-8124-44af-a1af-f21cd68b8265 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'create', calling method: .version_select at 0x7f113420d1f0>, body: {"keypair": {"name": "tempest-keypair-1377233749"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:46:54.325743 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-22d17dd8-8124-44af-a1af-f21cd68b8265 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Getting quotas for project 5cc524f131464fe097cff64187071316. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:46:54.346395 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-22d17dd8-8124-44af-a1af-f21cd68b8265 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Getting quotas for user ef90ae7586e94458bfffbae21ae6b9f5 and project 5cc524f131464fe097cff64187071316. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:46:55.326552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-22d17dd8-8124-44af-a1af-f21cd68b8265 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Getting quotas for project 5cc524f131464fe097cff64187071316. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:46:55.373004 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-22d17dd8-8124-44af-a1af-f21cd68b8265 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Getting quotas for user ef90ae7586e94458bfffbae21ae6b9f5 and project 5cc524f131464fe097cff64187071316. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:46:55.435408 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-22d17dd8-8124-44af-a1af-f21cd68b8265 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.478836 Nov 02 16:46:55.436845 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 15/37] 10.222.0.118 () {62 vars in 1203 bytes} [Tue Nov 2 16:46:53 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1481 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 02 16:46:55.453536 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-813ffc9c-73c0-4cc7-ac05-63daef58eec9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:55.454838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-813ffc9c-73c0-4cc7-ac05-63daef58eec9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:55.517153 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-813ffc9c-73c0-4cc7-ac05-63daef58eec9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:55.518451 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-813ffc9c-73c0-4cc7-ac05-63daef58eec9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:55.519836 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-813ffc9c-73c0-4cc7-ac05-63daef58eec9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:55.520233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-813ffc9c-73c0-4cc7-ac05-63daef58eec9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:55.775213 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-9efe5d83-a120-45a1-aeb6-e30bfe9788b1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:55.806179 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9efe5d83-a120-45a1-aeb6-e30bfe9788b1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 1.808100 Nov 02 16:46:55.808976 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 23/38] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:53 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:55.838596 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7b4fcc97-35c1-41ff-b724-71b68b07ccd7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:55.839550 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7b4fcc97-35c1-41ff-b724-71b68b07ccd7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:55.868908 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7b4fcc97-35c1-41ff-b724-71b68b07ccd7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:55.877446 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7b4fcc97-35c1-41ff-b724-71b68b07ccd7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:55.878977 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7b4fcc97-35c1-41ff-b724-71b68b07ccd7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:55.880529 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7b4fcc97-35c1-41ff-b724-71b68b07ccd7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:56.661977 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7b4fcc97-35c1-41ff-b724-71b68b07ccd7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:56.687378 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7b4fcc97-35c1-41ff-b724-71b68b07ccd7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.872854 Nov 02 16:46:56.688091 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 24/39] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:55 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:56.832098 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2fd638b0-6beb-4690-9bad-9801348a4ebb tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:56.833971 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2fd638b0-6beb-4690-9bad-9801348a4ebb tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:56.846706 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2fd638b0-6beb-4690-9bad-9801348a4ebb tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:56.850411 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2fd638b0-6beb-4690-9bad-9801348a4ebb tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:56.863862 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2fd638b0-6beb-4690-9bad-9801348a4ebb tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:56.865192 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2fd638b0-6beb-4690-9bad-9801348a4ebb tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:57.649833 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-813ffc9c-73c0-4cc7-ac05-63daef58eec9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:57.689025 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-813ffc9c-73c0-4cc7-ac05-63daef58eec9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 2.250369 Nov 02 16:46:57.689977 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 16/40] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:55 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:58.054842 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2fd638b0-6beb-4690-9bad-9801348a4ebb tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:58.077894 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2fd638b0-6beb-4690-9bad-9801348a4ebb tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 1.245402 Nov 02 16:46:58.079453 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 25/41] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:56 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:46:58.102247 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bf826040-a3e9-4748-9bb7-3d48ea5d2182 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:58.105714 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-bf826040-a3e9-4748-9bb7-3d48ea5d2182 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:58.121310 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-1cdeb0c1-babb-4c1c-a330-40f5fe690f8b req-f0770983-bded-47c0-b322-a0c79ded8a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5b406e-d37d-44b0-bb2f-39532baf3f9e", "tag": "8c95a943-ceda-4a49-8043-1035f5d14c4a"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:46:58.128766 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bf826040-a3e9-4748-9bb7-3d48ea5d2182 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:58.129912 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bf826040-a3e9-4748-9bb7-3d48ea5d2182 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:58.137494 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bf826040-a3e9-4748-9bb7-3d48ea5d2182 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:58.138734 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bf826040-a3e9-4748-9bb7-3d48ea5d2182 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:58.143631 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:46:58.143631 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:46:58.184762 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-1cdeb0c1-babb-4c1c-a330-40f5fe690f8b req-f0770983-bded-47c0-b322-a0c79ded8a27 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:58.185928 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-1cdeb0c1-babb-4c1c-a330-40f5fe690f8b req-f0770983-bded-47c0-b322-a0c79ded8a27 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:58.275477 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-1cdeb0c1-babb-4c1c-a330-40f5fe690f8b req-f0770983-bded-47c0-b322-a0c79ded8a27 service nova] Creating event network-changed:8c95a943-ceda-4a49-8043-1035f5d14c4a for instance 6e5b406e-d37d-44b0-bb2f-39532baf3f9e on hv-cinder-77387 Nov 02 16:46:58.278800 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-1cdeb0c1-babb-4c1c-a330-40f5fe690f8b req-f0770983-bded-47c0-b322-a0c79ded8a27 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 02 16:46:58.282832 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-faf40a09-e2fc-48e0-ab39-54218dfa299e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:58.293510 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-faf40a09-e2fc-48e0-ab39-54218dfa299e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:58.296863 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-faf40a09-e2fc-48e0-ab39-54218dfa299e None None] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:58.302382 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-faf40a09-e2fc-48e0-ab39-54218dfa299e None None] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:58.353922 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.compute.rpcapi [None req-faf40a09-e2fc-48e0-ab39-54218dfa299e None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 02 16:46:58.355951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-faf40a09-e2fc-48e0-ab39-54218dfa299e None None] Releasing lock "compute-rpcapi-router" {{(pid=127648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 02 16:46:58.483002 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-faf40a09-e2fc-48e0-ab39-54218dfa299e None None] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.791197 Nov 02 16:46:58.484758 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 17/42] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:46:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:46:58.717707 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3a3b690b-c1d1-456c-8633-be2b031af753 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:58.720592 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3a3b690b-c1d1-456c-8633-be2b031af753 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:58.742693 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a3b690b-c1d1-456c-8633-be2b031af753 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:58.743836 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a3b690b-c1d1-456c-8633-be2b031af753 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:58.749350 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a3b690b-c1d1-456c-8633-be2b031af753 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:58.750328 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a3b690b-c1d1-456c-8633-be2b031af753 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:58.934337 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-bf826040-a3e9-4748-9bb7-3d48ea5d2182 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:58.969519 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-bf826040-a3e9-4748-9bb7-3d48ea5d2182 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.883049 Nov 02 16:46:58.973234 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 26/43] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:58 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:59.111427 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-be211daa-c5b3-43f4-9b72-432681a37a2e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:59.113405 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-be211daa-c5b3-43f4-9b72-432681a37a2e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:46:59.132703 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-be211daa-c5b3-43f4-9b72-432681a37a2e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:59.133274 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-be211daa-c5b3-43f4-9b72-432681a37a2e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:59.141920 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-be211daa-c5b3-43f4-9b72-432681a37a2e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:46:59.142827 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-be211daa-c5b3-43f4-9b72-432681a37a2e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:46:59.551679 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3a3b690b-c1d1-456c-8633-be2b031af753 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:46:59.585148 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3a3b690b-c1d1-456c-8633-be2b031af753 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.877481 Nov 02 16:46:59.596708 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 18/44] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:58 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:46:59.989479 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6e67cede-ff92-4fd3-a719-5ece0b0d7577 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:46:59.990436 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6e67cede-ff92-4fd3-a719-5ece0b0d7577 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:00.016474 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6e67cede-ff92-4fd3-a719-5ece0b0d7577 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:00.018980 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6e67cede-ff92-4fd3-a719-5ece0b0d7577 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:00.020719 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6e67cede-ff92-4fd3-a719-5ece0b0d7577 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:00.026137 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6e67cede-ff92-4fd3-a719-5ece0b0d7577 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:00.239010 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-be211daa-c5b3-43f4-9b72-432681a37a2e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:00.258227 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-be211daa-c5b3-43f4-9b72-432681a37a2e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 1.151237 Nov 02 16:47:00.258921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 27/45] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:59 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:00.618732 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-64b6c733-a205-4635-a8b8-c03149deb773 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:00.620240 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-64b6c733-a205-4635-a8b8-c03149deb773 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:00.671716 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-64b6c733-a205-4635-a8b8-c03149deb773 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:00.672209 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-64b6c733-a205-4635-a8b8-c03149deb773 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:00.673100 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-64b6c733-a205-4635-a8b8-c03149deb773 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:00.680127 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-64b6c733-a205-4635-a8b8-c03149deb773 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:00.807130 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6e67cede-ff92-4fd3-a719-5ece0b0d7577 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:00.824444 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6e67cede-ff92-4fd3-a719-5ece0b0d7577 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.839582 Nov 02 16:47:00.826691 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 19/46] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:46:59 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:00.834889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-3f244c4f-a446-4bab-b5eb-23f5db66d94c req-941ff08b-45f4-4115-b9ba-6e9d58efa01c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72140edf-a256-42c5-96ab-aa20fadf6e0b", "tag": "9877734a-b105-41fe-bb14-bcc253387958"}, {"name": "network-changed", "server_uuid": "e699b34f-97c8-4316-9e80-4820d1f94e26", "tag": "6d3bae71-e514-49ab-9222-9632d4fba0f5"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:00.837616 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:47:00.837616 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:47:00.847946 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-3f244c4f-a446-4bab-b5eb-23f5db66d94c req-941ff08b-45f4-4115-b9ba-6e9d58efa01c service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:00.848988 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-3f244c4f-a446-4bab-b5eb-23f5db66d94c req-941ff08b-45f4-4115-b9ba-6e9d58efa01c service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:00.874010 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-3f244c4f-a446-4bab-b5eb-23f5db66d94c req-941ff08b-45f4-4115-b9ba-6e9d58efa01c service nova] Creating event network-changed:9877734a-b105-41fe-bb14-bcc253387958 for instance 72140edf-a256-42c5-96ab-aa20fadf6e0b on hv-cinder-77387 Nov 02 16:47:00.874926 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-3f244c4f-a446-4bab-b5eb-23f5db66d94c req-941ff08b-45f4-4115-b9ba-6e9d58efa01c service nova] Creating event network-changed:6d3bae71-e514-49ab-9222-9632d4fba0f5 for instance e699b34f-97c8-4316-9e80-4820d1f94e26 on hv-cinder-77387 Nov 02 16:47:00.897147 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-3f244c4f-a446-4bab-b5eb-23f5db66d94c req-941ff08b-45f4-4115-b9ba-6e9d58efa01c service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.059458 Nov 02 16:47:00.898135 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 20/47] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:47:00 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:01.291610 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5909fae4-61dc-4e95-924f-ca8950bec83f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:01.293251 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5909fae4-61dc-4e95-924f-ca8950bec83f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:01.315466 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5909fae4-61dc-4e95-924f-ca8950bec83f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:01.316071 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5909fae4-61dc-4e95-924f-ca8950bec83f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:01.317276 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5909fae4-61dc-4e95-924f-ca8950bec83f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:01.317834 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5909fae4-61dc-4e95-924f-ca8950bec83f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:01.648160 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-64b6c733-a205-4635-a8b8-c03149deb773 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:01.697581 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-64b6c733-a205-4635-a8b8-c03149deb773 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 1.098744 Nov 02 16:47:01.701842 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 28/48] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:00 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:01.953431 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-c65eb086-1169-49e9-bd2c-a95371f81158 req-86d20c04-f2e7-4bfe-907c-4de08aa58027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17da9bbd-fb82-4abe-a41e-4edac4b87bc7", "tag": "4c21c6a5-6c5e-47dc-9609-26483e9e33f3"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:01.962078 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:47:01.962078 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:47:02.026156 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-c65eb086-1169-49e9-bd2c-a95371f81158 req-86d20c04-f2e7-4bfe-907c-4de08aa58027 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:02.026858 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-c65eb086-1169-49e9-bd2c-a95371f81158 req-86d20c04-f2e7-4bfe-907c-4de08aa58027 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:02.101269 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-c65eb086-1169-49e9-bd2c-a95371f81158 req-86d20c04-f2e7-4bfe-907c-4de08aa58027 service nova] Creating event network-changed:4c21c6a5-6c5e-47dc-9609-26483e9e33f3 for instance 17da9bbd-fb82-4abe-a41e-4edac4b87bc7 on hv-cinder-77387 Nov 02 16:47:02.103922 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-c65eb086-1169-49e9-bd2c-a95371f81158 req-86d20c04-f2e7-4bfe-907c-4de08aa58027 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127649) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 02 16:47:02.110430 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6ef113a6-f869-4a02-afbb-e0157966baa9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:02.113177 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6ef113a6-f869-4a02-afbb-e0157966baa9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:02.120026 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6ef113a6-f869-4a02-afbb-e0157966baa9 None None] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:02.129589 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6ef113a6-f869-4a02-afbb-e0157966baa9 None None] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:02.174968 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.compute.rpcapi [None req-6ef113a6-f869-4a02-afbb-e0157966baa9 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 02 16:47:02.181764 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6ef113a6-f869-4a02-afbb-e0157966baa9 None None] Releasing lock "compute-rpcapi-router" {{(pid=127649) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 02 16:47:02.275951 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6ef113a6-f869-4a02-afbb-e0157966baa9 None None] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.569614 Nov 02 16:47:02.277252 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 29/49] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:47:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:02.289211 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a279db81-3eff-49d3-b710-8d9f837d8532 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:02.295504 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a279db81-3eff-49d3-b710-8d9f837d8532 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:02.323944 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a279db81-3eff-49d3-b710-8d9f837d8532 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:02.325623 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a279db81-3eff-49d3-b710-8d9f837d8532 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:02.326893 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a279db81-3eff-49d3-b710-8d9f837d8532 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:02.327659 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a279db81-3eff-49d3-b710-8d9f837d8532 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:02.347578 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5909fae4-61dc-4e95-924f-ca8950bec83f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:02.367081 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5909fae4-61dc-4e95-924f-ca8950bec83f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 1.081846 Nov 02 16:47:02.374509 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 21/50] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:01 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:02.447951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-47757240", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3ac4ab4-0ce0-4abb-9960-272f99ead558"}], "security_groups": [{"name": "tempest-securitygroup--344357715"}], "key_name": "tempest-keypair-1875712050", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:02.728210 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.network.neutron [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] validate_networks() for [('c3ac4ab4-0ce0-4abb-9960-272f99ead558', None, None, None, None, None)] {{(pid=127648) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:47:02.936969 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a279db81-3eff-49d3-b710-8d9f837d8532 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:02.947438 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a279db81-3eff-49d3-b710-8d9f837d8532 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.668437 Nov 02 16:47:02.948970 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 30/51] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:02 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:02.955698 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1378216181", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2642968c-324e-4035-9dba-a5695e42fc1f"}], "security_groups": [{"name": "tempest-securitygroup--1307669026"}], "key_name": "tempest-keypair-1377233749", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:03.144023 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.network.neutron [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] validate_networks() for [('2642968c-324e-4035-9dba-a5695e42fc1f', None, None, None, None, None)] {{(pid=127649) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:47:03.598534 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Flavor limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:47:03.600499 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Image limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:47:03.601479 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Flavor pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:47:03.602109 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Image pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:47:03.602743 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:47:03.616444 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:03.617091 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:03.618023 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:03.618666 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:03.658318 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Getting quotas for project a575c6bd2e574ad19dc299cc1df253f3. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:47:03.670850 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Getting quotas for user 821a58487d5b4087bac538d532382aef and project a575c6bd2e574ad19dc299cc1df253f3. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:47:03.696719 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Going to run 1 instances... {{(pid=127648) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:47:03.702573 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:47:03.800361 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-8e329d80-f196-4f0c-9841-5d7e3f1c7550 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.357934 Nov 02 16:47:03.812700 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 22/52] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:47:02 2021] POST /compute/v2.1/servers => generated 403 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:47:03.822613 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-148bafae-fba2-4f91-ad8d-44625a2b9ce9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:03.824809 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-148bafae-fba2-4f91-ad8d-44625a2b9ce9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:03.838080 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-148bafae-fba2-4f91-ad8d-44625a2b9ce9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:03.839317 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-148bafae-fba2-4f91-ad8d-44625a2b9ce9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:03.842761 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-148bafae-fba2-4f91-ad8d-44625a2b9ce9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:03.844006 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-148bafae-fba2-4f91-ad8d-44625a2b9ce9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:03.890825 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Flavor limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:47:03.891352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Image limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:47:03.891874 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Flavor pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:47:03.892386 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Image pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:47:03.893210 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:47:03.923112 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:03.925411 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:03.926738 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:03.927209 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:03.964694 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Getting quotas for project 5cc524f131464fe097cff64187071316. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:47:03.971873 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Getting quotas for user ef90ae7586e94458bfffbae21ae6b9f5 and project 5cc524f131464fe097cff64187071316. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:47:03.987981 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Going to run 1 instances... {{(pid=127649) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:47:03.993237 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:47:04.065564 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6ebfe5f7-1435-4341-a290-037642c1b9d0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 1.114874 Nov 02 16:47:04.067316 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 31/53] 10.222.0.118 () {62 vars in 1192 bytes} [Tue Nov 2 16:47:02 2021] POST /compute/v2.1/servers => generated 404 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 16:47:04.074788 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-31adabe6-8344-4e9f-b6df-8b3cb7ddeb88 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:04.075966 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-31adabe6-8344-4e9f-b6df-8b3cb7ddeb88 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:04.086204 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-31adabe6-8344-4e9f-b6df-8b3cb7ddeb88 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:04.086951 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-31adabe6-8344-4e9f-b6df-8b3cb7ddeb88 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:04.088075 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-31adabe6-8344-4e9f-b6df-8b3cb7ddeb88 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:04.088699 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-31adabe6-8344-4e9f-b6df-8b3cb7ddeb88 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:04.263489 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-148bafae-fba2-4f91-ad8d-44625a2b9ce9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:04.275983 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-148bafae-fba2-4f91-ad8d-44625a2b9ce9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.461316 Nov 02 16:47:04.277159 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 23/54] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:03 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:04.292619 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-435d09bd-2bf4-498b-9c5c-1575d8278930 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:04.294730 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-435d09bd-2bf4-498b-9c5c-1575d8278930 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:04.395145 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-31adabe6-8344-4e9f-b6df-8b3cb7ddeb88 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:04.406388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-31adabe6-8344-4e9f-b6df-8b3cb7ddeb88 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.336752 Nov 02 16:47:04.407395 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 32/55] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:04 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:04.413760 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-015c814d-307d-4632-83f4-655f162913d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:04.414601 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-015c814d-307d-4632-83f4-655f162913d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:04.430029 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-015c814d-307d-4632-83f4-655f162913d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:04.430621 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-015c814d-307d-4632-83f4-655f162913d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:04.431969 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-015c814d-307d-4632-83f4-655f162913d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:04.432547 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-015c814d-307d-4632-83f4-655f162913d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:04.488803 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-435d09bd-2bf4-498b-9c5c-1575d8278930 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:04.500364 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-435d09bd-2bf4-498b-9c5c-1575d8278930 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1240 microversion: 2.1 time: 0.217638 Nov 02 16:47:04.503039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 24/56] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:04 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1240 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:04.520799 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-132fcee7-c663-4d4f-b3c9-f75d466cfc8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:04.521995 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-132fcee7-c663-4d4f-b3c9-f75d466cfc8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:04.664226 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-132fcee7-c663-4d4f-b3c9-f75d466cfc8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:04.702908 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-132fcee7-c663-4d4f-b3c9-f75d466cfc8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:04.710347 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-132fcee7-c663-4d4f-b3c9-f75d466cfc8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:04.714552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-132fcee7-c663-4d4f-b3c9-f75d466cfc8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1286 microversion: 2.20 time: 0.198357 Nov 02 16:47:04.717396 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 25/57] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:04 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1286 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:04.876298 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-015c814d-307d-4632-83f4-655f162913d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:04.893198 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-015c814d-307d-4632-83f4-655f162913d5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.484279 Nov 02 16:47:04.895231 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 33/58] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:04 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:05.295026 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ca7bf617-b2c6-4c35-a362-eff67cb3a2f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:05.295700 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ca7bf617-b2c6-4c35-a362-eff67cb3a2f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:05.304723 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ca7bf617-b2c6-4c35-a362-eff67cb3a2f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:05.305209 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ca7bf617-b2c6-4c35-a362-eff67cb3a2f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:05.341654 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ca7bf617-b2c6-4c35-a362-eff67cb3a2f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:05.341654 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ca7bf617-b2c6-4c35-a362-eff67cb3a2f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:05.437881 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-305e7fa2-f210-457c-b284-855608beb90e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:05.439055 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-305e7fa2-f210-457c-b284-855608beb90e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:05.448716 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-305e7fa2-f210-457c-b284-855608beb90e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:05.449396 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-305e7fa2-f210-457c-b284-855608beb90e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:05.450880 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-305e7fa2-f210-457c-b284-855608beb90e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:05.451592 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-305e7fa2-f210-457c-b284-855608beb90e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:05.556955 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ca7bf617-b2c6-4c35-a362-eff67cb3a2f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:05.572391 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ca7bf617-b2c6-4c35-a362-eff67cb3a2f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.280971 Nov 02 16:47:05.584318 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 26/59] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:05 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:05.584318 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f9ca06de-c9df-4597-8dd1-95bf92e8e03e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:05.585794 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f9ca06de-c9df-4597-8dd1-95bf92e8e03e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:05.599522 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f9ca06de-c9df-4597-8dd1-95bf92e8e03e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:05.600891 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f9ca06de-c9df-4597-8dd1-95bf92e8e03e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:05.602638 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f9ca06de-c9df-4597-8dd1-95bf92e8e03e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:05.603611 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f9ca06de-c9df-4597-8dd1-95bf92e8e03e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:05.647115 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-305e7fa2-f210-457c-b284-855608beb90e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:05.659359 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-305e7fa2-f210-457c-b284-855608beb90e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.225456 Nov 02 16:47:05.660312 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 34/60] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:05 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:05.726994 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f9ca06de-c9df-4597-8dd1-95bf92e8e03e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:05.743515 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f9ca06de-c9df-4597-8dd1-95bf92e8e03e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1244 microversion: 2.1 time: 0.167066 Nov 02 16:47:05.745827 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 27/61] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:05 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1244 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:05.754401 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0b85f45a-30b6-4b67-8414-918954a99b52 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:05.755393 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0b85f45a-30b6-4b67-8414-918954a99b52 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:05.766846 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b85f45a-30b6-4b67-8414-918954a99b52 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:05.768089 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b85f45a-30b6-4b67-8414-918954a99b52 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:05.769409 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b85f45a-30b6-4b67-8414-918954a99b52 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:05.770000 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b85f45a-30b6-4b67-8414-918954a99b52 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:05.847955 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0b85f45a-30b6-4b67-8414-918954a99b52 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:05.858801 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0b85f45a-30b6-4b67-8414-918954a99b52 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:05.860628 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0b85f45a-30b6-4b67-8414-918954a99b52 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:05.861878 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0b85f45a-30b6-4b67-8414-918954a99b52 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1290 microversion: 2.20 time: 0.126633 Nov 02 16:47:05.862525 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 35/62] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:05 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1290 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:05.912614 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5c3c4550-b06c-4690-ac73-d6adb2d08aa9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:05.913280 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5c3c4550-b06c-4690-ac73-d6adb2d08aa9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:05.920261 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5c3c4550-b06c-4690-ac73-d6adb2d08aa9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:05.920774 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5c3c4550-b06c-4690-ac73-d6adb2d08aa9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:05.921595 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5c3c4550-b06c-4690-ac73-d6adb2d08aa9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:05.922073 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5c3c4550-b06c-4690-ac73-d6adb2d08aa9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:06.117806 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5c3c4550-b06c-4690-ac73-d6adb2d08aa9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:06.126748 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5c3c4550-b06c-4690-ac73-d6adb2d08aa9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.218528 Nov 02 16:47:06.127417 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 28/63] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:05 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:06.591469 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0f8bfbfb-6d27-43e9-b6fb-c55adb1c3ac6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:06.592612 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0f8bfbfb-6d27-43e9-b6fb-c55adb1c3ac6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:06.601229 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0f8bfbfb-6d27-43e9-b6fb-c55adb1c3ac6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:06.601712 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0f8bfbfb-6d27-43e9-b6fb-c55adb1c3ac6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:06.602571 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0f8bfbfb-6d27-43e9-b6fb-c55adb1c3ac6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:06.603097 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0f8bfbfb-6d27-43e9-b6fb-c55adb1c3ac6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:06.687459 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e6eea3ee-51c9-407e-9d63-fe9f2a55aa47 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:06.689004 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e6eea3ee-51c9-407e-9d63-fe9f2a55aa47 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:06.710031 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e6eea3ee-51c9-407e-9d63-fe9f2a55aa47 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:06.711183 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e6eea3ee-51c9-407e-9d63-fe9f2a55aa47 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:06.713606 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e6eea3ee-51c9-407e-9d63-fe9f2a55aa47 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:06.714966 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e6eea3ee-51c9-407e-9d63-fe9f2a55aa47 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:06.883375 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0f8bfbfb-6d27-43e9-b6fb-c55adb1c3ac6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:06.902086 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0f8bfbfb-6d27-43e9-b6fb-c55adb1c3ac6 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.314873 Nov 02 16:47:06.912382 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 36/64] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:06 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:06.918289 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7b23fe8a-1910-47a2-a4be-4cf46bc11273 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:06.919207 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7b23fe8a-1910-47a2-a4be-4cf46bc11273 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:06.926568 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7b23fe8a-1910-47a2-a4be-4cf46bc11273 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:06.927544 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7b23fe8a-1910-47a2-a4be-4cf46bc11273 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:06.929571 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7b23fe8a-1910-47a2-a4be-4cf46bc11273 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:06.930236 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7b23fe8a-1910-47a2-a4be-4cf46bc11273 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:06.988112 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e6eea3ee-51c9-407e-9d63-fe9f2a55aa47 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:06.997905 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e6eea3ee-51c9-407e-9d63-fe9f2a55aa47 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.323137 Nov 02 16:47:06.998623 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 29/65] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:06 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:07.007922 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7b23fe8a-1910-47a2-a4be-4cf46bc11273 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:07.008674 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d64ff4ce-49c4-4df6-b716-64afc4c84d90 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:07.009492 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d64ff4ce-49c4-4df6-b716-64afc4c84d90 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:07.018521 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d64ff4ce-49c4-4df6-b716-64afc4c84d90 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:07.018961 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7b23fe8a-1910-47a2-a4be-4cf46bc11273 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1244 microversion: 2.1 time: 0.104792 Nov 02 16:47:07.019863 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 37/66] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:06 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1244 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:07.020372 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d64ff4ce-49c4-4df6-b716-64afc4c84d90 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:07.022072 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d64ff4ce-49c4-4df6-b716-64afc4c84d90 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:07.022802 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d64ff4ce-49c4-4df6-b716-64afc4c84d90 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:07.103390 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d64ff4ce-49c4-4df6-b716-64afc4c84d90 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:07.113723 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d64ff4ce-49c4-4df6-b716-64afc4c84d90 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:07.116297 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d64ff4ce-49c4-4df6-b716-64afc4c84d90 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:07.117574 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d64ff4ce-49c4-4df6-b716-64afc4c84d90 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1290 microversion: 2.20 time: 0.117644 Nov 02 16:47:07.118222 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 30/67] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:06 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1290 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:07.145774 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-159c6107-fdc3-44d0-808f-eb87860deba9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:07.146707 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-159c6107-fdc3-44d0-808f-eb87860deba9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:07.154620 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-159c6107-fdc3-44d0-808f-eb87860deba9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:07.155085 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-159c6107-fdc3-44d0-808f-eb87860deba9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:07.155917 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-159c6107-fdc3-44d0-808f-eb87860deba9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:07.156415 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-159c6107-fdc3-44d0-808f-eb87860deba9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:07.361195 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-159c6107-fdc3-44d0-808f-eb87860deba9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:07.377066 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-159c6107-fdc3-44d0-808f-eb87860deba9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.235226 Nov 02 16:47:07.378028 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 38/68] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:07 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:07.924764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9fa021dd-114b-434f-872b-8b328ba928c1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:07.925765 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9fa021dd-114b-434f-872b-8b328ba928c1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:07.937714 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9fa021dd-114b-434f-872b-8b328ba928c1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:07.938136 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9fa021dd-114b-434f-872b-8b328ba928c1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:07.939387 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9fa021dd-114b-434f-872b-8b328ba928c1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:07.940265 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9fa021dd-114b-434f-872b-8b328ba928c1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:08.032409 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8b3c4c25-7d4c-43f3-bc63-5f3c4e335e74 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:08.037135 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8b3c4c25-7d4c-43f3-bc63-5f3c4e335e74 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:08.050930 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8b3c4c25-7d4c-43f3-bc63-5f3c4e335e74 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:08.051412 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8b3c4c25-7d4c-43f3-bc63-5f3c4e335e74 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:08.053006 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8b3c4c25-7d4c-43f3-bc63-5f3c4e335e74 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:08.054161 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8b3c4c25-7d4c-43f3-bc63-5f3c4e335e74 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:08.652375 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8b3c4c25-7d4c-43f3-bc63-5f3c4e335e74 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:08.669371 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8b3c4c25-7d4c-43f3-bc63-5f3c4e335e74 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.645396 Nov 02 16:47:08.670276 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 39/69] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:08 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:08.676661 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-78028d47-a496-466c-99f1-82a45870b2a9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:08.692752 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-78028d47-a496-466c-99f1-82a45870b2a9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:08.713300 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78028d47-a496-466c-99f1-82a45870b2a9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:08.714339 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78028d47-a496-466c-99f1-82a45870b2a9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:08.715583 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78028d47-a496-466c-99f1-82a45870b2a9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:08.716408 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78028d47-a496-466c-99f1-82a45870b2a9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:08.884627 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-78028d47-a496-466c-99f1-82a45870b2a9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:08.906973 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-78028d47-a496-466c-99f1-82a45870b2a9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1236 microversion: 2.1 time: 0.234577 Nov 02 16:47:08.911462 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 40/70] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:08 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1236 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:08.920137 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-be464965-39ff-492b-a167-98a972249b80 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:08.921964 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-be464965-39ff-492b-a167-98a972249b80 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:08.933368 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-be464965-39ff-492b-a167-98a972249b80 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:08.933884 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-be464965-39ff-492b-a167-98a972249b80 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:08.935301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-be464965-39ff-492b-a167-98a972249b80 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:08.935872 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-be464965-39ff-492b-a167-98a972249b80 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:09.109692 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-be464965-39ff-492b-a167-98a972249b80 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:09.174333 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-be464965-39ff-492b-a167-98a972249b80 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:09.179822 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-be464965-39ff-492b-a167-98a972249b80 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:09.184714 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-be464965-39ff-492b-a167-98a972249b80 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1338 microversion: 2.20 time: 0.270216 Nov 02 16:47:09.185535 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 41/71] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:08 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1338 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:09.185535 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e249cbd4-8f08-4c51-bd26-3131ced39c90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:09.185535 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e249cbd4-8f08-4c51-bd26-3131ced39c90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:09.240753 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e249cbd4-8f08-4c51-bd26-3131ced39c90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:09.246272 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e249cbd4-8f08-4c51-bd26-3131ced39c90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:09.249999 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e249cbd4-8f08-4c51-bd26-3131ced39c90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:09.257974 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e249cbd4-8f08-4c51-bd26-3131ced39c90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:09.315490 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9fa021dd-114b-434f-872b-8b328ba928c1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:09.339569 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9fa021dd-114b-434f-872b-8b328ba928c1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 1.421410 Nov 02 16:47:09.352820 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 31/72] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:07 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:09.690823 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-753efb11-d22b-44b1-9ea3-e76ec40c92e5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:09.691490 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-753efb11-d22b-44b1-9ea3-e76ec40c92e5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:09.704830 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-753efb11-d22b-44b1-9ea3-e76ec40c92e5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:09.705224 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-753efb11-d22b-44b1-9ea3-e76ec40c92e5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:09.706308 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-753efb11-d22b-44b1-9ea3-e76ec40c92e5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:09.708867 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-753efb11-d22b-44b1-9ea3-e76ec40c92e5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:10.050310 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e249cbd4-8f08-4c51-bd26-3131ced39c90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:10.090943 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e249cbd4-8f08-4c51-bd26-3131ced39c90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.901957 Nov 02 16:47:10.100482 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 42/73] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:09 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:10.115803 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b303c2db-1f7d-43cc-961a-f9fb0ec2579c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:10.116998 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b303c2db-1f7d-43cc-961a-f9fb0ec2579c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:10.131374 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b303c2db-1f7d-43cc-961a-f9fb0ec2579c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:10.132495 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b303c2db-1f7d-43cc-961a-f9fb0ec2579c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:10.133689 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b303c2db-1f7d-43cc-961a-f9fb0ec2579c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:10.134664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b303c2db-1f7d-43cc-961a-f9fb0ec2579c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:10.314342 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b303c2db-1f7d-43cc-961a-f9fb0ec2579c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:10.327436 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b303c2db-1f7d-43cc-961a-f9fb0ec2579c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1300 microversion: 2.1 time: 0.225258 Nov 02 16:47:10.338934 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 43/74] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:10 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1300 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:10.346716 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2e3217a7-2003-4e14-9dc8-d0b9c2834a32 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:10.357575 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2e3217a7-2003-4e14-9dc8-d0b9c2834a32 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:10.380298 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2e3217a7-2003-4e14-9dc8-d0b9c2834a32 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:10.393413 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2e3217a7-2003-4e14-9dc8-d0b9c2834a32 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:10.397505 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2e3217a7-2003-4e14-9dc8-d0b9c2834a32 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:10.398271 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2e3217a7-2003-4e14-9dc8-d0b9c2834a32 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:10.982180 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2e3217a7-2003-4e14-9dc8-d0b9c2834a32 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:11.016147 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2e3217a7-2003-4e14-9dc8-d0b9c2834a32 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:11.021790 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2e3217a7-2003-4e14-9dc8-d0b9c2834a32 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:11.029994 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2e3217a7-2003-4e14-9dc8-d0b9c2834a32 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1344 microversion: 2.20 time: 0.689273 Nov 02 16:47:11.030763 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 44/75] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:10 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1344 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:11.049766 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a3b7c4b9-9e50-4012-a6ef-25ea7cfd06df tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:11.050737 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a3b7c4b9-9e50-4012-a6ef-25ea7cfd06df tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:11.061651 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a3b7c4b9-9e50-4012-a6ef-25ea7cfd06df tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:11.062557 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a3b7c4b9-9e50-4012-a6ef-25ea7cfd06df tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:11.063812 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a3b7c4b9-9e50-4012-a6ef-25ea7cfd06df tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:11.065093 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a3b7c4b9-9e50-4012-a6ef-25ea7cfd06df tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:11.383289 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-753efb11-d22b-44b1-9ea3-e76ec40c92e5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:11.402480 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-753efb11-d22b-44b1-9ea3-e76ec40c92e5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 1.715721 Nov 02 16:47:11.409892 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 32/76] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:09 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:11.425764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0f3a394a-e1d3-4f9c-89f4-6f6fa1779352 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:11.428592 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0f3a394a-e1d3-4f9c-89f4-6f6fa1779352 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:11.442040 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0f3a394a-e1d3-4f9c-89f4-6f6fa1779352 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:11.444435 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0f3a394a-e1d3-4f9c-89f4-6f6fa1779352 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:11.446945 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0f3a394a-e1d3-4f9c-89f4-6f6fa1779352 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:11.448518 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0f3a394a-e1d3-4f9c-89f4-6f6fa1779352 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:11.749058 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a3b7c4b9-9e50-4012-a6ef-25ea7cfd06df tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:11.794651 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a3b7c4b9-9e50-4012-a6ef-25ea7cfd06df tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.745591 Nov 02 16:47:11.811718 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 45/77] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:11 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:11.847147 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-69ef6a86-cdee-4aa2-9c58-d73059785188 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:11.848573 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-69ef6a86-cdee-4aa2-9c58-d73059785188 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:11.912958 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-69ef6a86-cdee-4aa2-9c58-d73059785188 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:11.935747 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-69ef6a86-cdee-4aa2-9c58-d73059785188 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:11.944889 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-69ef6a86-cdee-4aa2-9c58-d73059785188 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:11.947109 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-69ef6a86-cdee-4aa2-9c58-d73059785188 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:12.219160 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-69ef6a86-cdee-4aa2-9c58-d73059785188 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:12.235039 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-69ef6a86-cdee-4aa2-9c58-d73059785188 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1298 microversion: 2.1 time: 0.413741 Nov 02 16:47:12.236509 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 46/78] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:11 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1298 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:12.247349 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-05630981-a387-45f7-93c1-31a645704e10 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:12.248360 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-05630981-a387-45f7-93c1-31a645704e10 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:12.266398 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-05630981-a387-45f7-93c1-31a645704e10 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:12.273185 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-05630981-a387-45f7-93c1-31a645704e10 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:12.274666 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-05630981-a387-45f7-93c1-31a645704e10 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:12.275367 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-05630981-a387-45f7-93c1-31a645704e10 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:12.356681 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0f3a394a-e1d3-4f9c-89f4-6f6fa1779352 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:12.372862 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0f3a394a-e1d3-4f9c-89f4-6f6fa1779352 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.961016 Nov 02 16:47:12.374097 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 33/79] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:11 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:12.429997 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-30aeda3e-ce54-4c3c-bbc4-b492686b1d98 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:12.431860 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-30aeda3e-ce54-4c3c-bbc4-b492686b1d98 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:12.445243 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30aeda3e-ce54-4c3c-bbc4-b492686b1d98 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:12.446418 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30aeda3e-ce54-4c3c-bbc4-b492686b1d98 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:12.447350 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30aeda3e-ce54-4c3c-bbc4-b492686b1d98 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:12.448623 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30aeda3e-ce54-4c3c-bbc4-b492686b1d98 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:12.637705 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-05630981-a387-45f7-93c1-31a645704e10 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:12.649192 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-05630981-a387-45f7-93c1-31a645704e10 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:12.650789 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-05630981-a387-45f7-93c1-31a645704e10 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:12.652378 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-05630981-a387-45f7-93c1-31a645704e10 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.414541 Nov 02 16:47:12.653115 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 47/80] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:12 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:12.829448 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-82e5353e-ef70-47ed-b4e5-010d4f426499 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:12.830210 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-82e5353e-ef70-47ed-b4e5-010d4f426499 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:12.837683 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-82e5353e-ef70-47ed-b4e5-010d4f426499 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:12.838600 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-82e5353e-ef70-47ed-b4e5-010d4f426499 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:12.839649 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-82e5353e-ef70-47ed-b4e5-010d4f426499 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:12.840412 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-82e5353e-ef70-47ed-b4e5-010d4f426499 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:12.883406 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-30aeda3e-ce54-4c3c-bbc4-b492686b1d98 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:12.896614 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-30aeda3e-ce54-4c3c-bbc4-b492686b1d98 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.470738 Nov 02 16:47:12.898225 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 34/81] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:12 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:13.001220 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-82e5353e-ef70-47ed-b4e5-010d4f426499 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:13.011591 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-82e5353e-ef70-47ed-b4e5-010d4f426499 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.186889 Nov 02 16:47:13.012440 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 48/82] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:12 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:13.268127 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-db6cba6b-7bc1-42eb-ac4e-b19a69e2567a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:13.269325 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-db6cba6b-7bc1-42eb-ac4e-b19a69e2567a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:13.277139 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-db6cba6b-7bc1-42eb-ac4e-b19a69e2567a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:13.277614 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-db6cba6b-7bc1-42eb-ac4e-b19a69e2567a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:13.278435 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-db6cba6b-7bc1-42eb-ac4e-b19a69e2567a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:13.279076 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-db6cba6b-7bc1-42eb-ac4e-b19a69e2567a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:13.395926 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ec1ec316-f7d5-4fae-8256-dacc7b726d3c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:13.396801 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ec1ec316-f7d5-4fae-8256-dacc7b726d3c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:13.404510 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec1ec316-f7d5-4fae-8256-dacc7b726d3c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:13.404976 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec1ec316-f7d5-4fae-8256-dacc7b726d3c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:13.405785 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec1ec316-f7d5-4fae-8256-dacc7b726d3c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:13.406298 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec1ec316-f7d5-4fae-8256-dacc7b726d3c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:13.469062 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-db6cba6b-7bc1-42eb-ac4e-b19a69e2567a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:13.479152 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-db6cba6b-7bc1-42eb-ac4e-b19a69e2567a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.218191 Nov 02 16:47:13.480466 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 35/83] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:13 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:13.574624 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ec1ec316-f7d5-4fae-8256-dacc7b726d3c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:13.583657 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ec1ec316-f7d5-4fae-8256-dacc7b726d3c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.195256 Nov 02 16:47:13.584440 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 49/84] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:13 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:13.673633 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-641ad27f-b52a-490b-b66f-52cd98ea7faf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:13.674525 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-641ad27f-b52a-490b-b66f-52cd98ea7faf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:13.682194 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-641ad27f-b52a-490b-b66f-52cd98ea7faf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:13.683374 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-641ad27f-b52a-490b-b66f-52cd98ea7faf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:13.683547 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-641ad27f-b52a-490b-b66f-52cd98ea7faf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:13.683897 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-641ad27f-b52a-490b-b66f-52cd98ea7faf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:13.907774 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-641ad27f-b52a-490b-b66f-52cd98ea7faf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:13.918430 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1453ab60-5f05-4433-9b5d-d599904efe58 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:13.919186 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1453ab60-5f05-4433-9b5d-d599904efe58 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:13.931833 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-641ad27f-b52a-490b-b66f-52cd98ea7faf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:13.935984 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1453ab60-5f05-4433-9b5d-d599904efe58 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:13.936490 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1453ab60-5f05-4433-9b5d-d599904efe58 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:13.936923 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-641ad27f-b52a-490b-b66f-52cd98ea7faf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:13.939844 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-641ad27f-b52a-490b-b66f-52cd98ea7faf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.269918 Nov 02 16:47:13.941511 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1453ab60-5f05-4433-9b5d-d599904efe58 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:13.942121 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1453ab60-5f05-4433-9b5d-d599904efe58 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:13.949511 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 36/85] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:13 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:14.031271 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0366a4b8-ed50-4863-8482-60937570ff2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:14.031914 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0366a4b8-ed50-4863-8482-60937570ff2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:14.043137 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0366a4b8-ed50-4863-8482-60937570ff2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:14.043600 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0366a4b8-ed50-4863-8482-60937570ff2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:14.044703 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0366a4b8-ed50-4863-8482-60937570ff2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:14.045079 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0366a4b8-ed50-4863-8482-60937570ff2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:14.198115 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1453ab60-5f05-4433-9b5d-d599904efe58 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:14.207068 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1453ab60-5f05-4433-9b5d-d599904efe58 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.292935 Nov 02 16:47:14.209183 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 50/86] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:13 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:14.228873 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0366a4b8-ed50-4863-8482-60937570ff2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:14.237511 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0366a4b8-ed50-4863-8482-60937570ff2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.212503 Nov 02 16:47:14.238193 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 37/87] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:14 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:14.497967 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5a4a68eb-cbc9-4ec3-9ed0-03dacbbf069e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:14.499422 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5a4a68eb-cbc9-4ec3-9ed0-03dacbbf069e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:14.507383 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5a4a68eb-cbc9-4ec3-9ed0-03dacbbf069e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:14.507840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5a4a68eb-cbc9-4ec3-9ed0-03dacbbf069e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:14.508746 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5a4a68eb-cbc9-4ec3-9ed0-03dacbbf069e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:14.509193 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5a4a68eb-cbc9-4ec3-9ed0-03dacbbf069e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:14.603844 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-88b7d414-76a9-4f2c-804d-9285c8146dfe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:14.604578 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-88b7d414-76a9-4f2c-804d-9285c8146dfe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:14.628060 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-88b7d414-76a9-4f2c-804d-9285c8146dfe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:14.628665 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-88b7d414-76a9-4f2c-804d-9285c8146dfe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:14.629528 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-88b7d414-76a9-4f2c-804d-9285c8146dfe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:14.630049 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-88b7d414-76a9-4f2c-804d-9285c8146dfe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:14.669252 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5a4a68eb-cbc9-4ec3-9ed0-03dacbbf069e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:14.677900 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5a4a68eb-cbc9-4ec3-9ed0-03dacbbf069e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.183896 Nov 02 16:47:14.678538 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 51/88] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:14 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:14.881896 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-88b7d414-76a9-4f2c-804d-9285c8146dfe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:14.890461 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-88b7d414-76a9-4f2c-804d-9285c8146dfe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.291129 Nov 02 16:47:14.891097 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 38/89] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:14 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:14.969584 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-42a1d68a-09a6-493a-910b-8f4db9bdb7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:14.970254 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-42a1d68a-09a6-493a-910b-8f4db9bdb7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:14.978375 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-42a1d68a-09a6-493a-910b-8f4db9bdb7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:14.978843 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-42a1d68a-09a6-493a-910b-8f4db9bdb7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:14.979720 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-42a1d68a-09a6-493a-910b-8f4db9bdb7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:14.980167 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-42a1d68a-09a6-493a-910b-8f4db9bdb7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:15.227880 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5be6da65-d1b3-4c81-8a0b-fd590b74dae3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:15.229155 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5be6da65-d1b3-4c81-8a0b-fd590b74dae3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:15.245089 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5be6da65-d1b3-4c81-8a0b-fd590b74dae3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:15.246579 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5be6da65-d1b3-4c81-8a0b-fd590b74dae3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:15.247617 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5be6da65-d1b3-4c81-8a0b-fd590b74dae3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:15.249554 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5be6da65-d1b3-4c81-8a0b-fd590b74dae3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:15.297988 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-42a1d68a-09a6-493a-910b-8f4db9bdb7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:15.308703 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-42a1d68a-09a6-493a-910b-8f4db9bdb7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:15.310713 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-42a1d68a-09a6-493a-910b-8f4db9bdb7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:15.312254 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-42a1d68a-09a6-493a-910b-8f4db9bdb7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.348812 Nov 02 16:47:15.323816 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 52/90] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:14 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:15.330444 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0b01e655-8be7-4c6d-87e8-6c9fcb4641de tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:15.331669 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0b01e655-8be7-4c6d-87e8-6c9fcb4641de tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:15.339846 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b01e655-8be7-4c6d-87e8-6c9fcb4641de tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:15.340838 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b01e655-8be7-4c6d-87e8-6c9fcb4641de tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:15.342001 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b01e655-8be7-4c6d-87e8-6c9fcb4641de tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:15.342740 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b01e655-8be7-4c6d-87e8-6c9fcb4641de tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:15.739490 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0b01e655-8be7-4c6d-87e8-6c9fcb4641de tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:15.755722 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0b01e655-8be7-4c6d-87e8-6c9fcb4641de tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.429484 Nov 02 16:47:15.756974 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 53/91] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:15 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:15.766491 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-88d175f0-49c9-45c9-963a-1a8870d1dce6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:15.767776 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-88d175f0-49c9-45c9-963a-1a8870d1dce6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:15.779555 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-88d175f0-49c9-45c9-963a-1a8870d1dce6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:15.780822 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-88d175f0-49c9-45c9-963a-1a8870d1dce6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:15.782155 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-88d175f0-49c9-45c9-963a-1a8870d1dce6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:15.783057 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-88d175f0-49c9-45c9-963a-1a8870d1dce6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:16.012244 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5be6da65-d1b3-4c81-8a0b-fd590b74dae3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:16.056735 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5be6da65-d1b3-4c81-8a0b-fd590b74dae3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.825807 Nov 02 16:47:16.058431 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 39/92] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:15 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:16.087705 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-809eedb6-6056-4e41-afd7-dac9ca3ba920 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:16.088583 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-809eedb6-6056-4e41-afd7-dac9ca3ba920 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:16.092137 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-88d175f0-49c9-45c9-963a-1a8870d1dce6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:16.106400 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-88d175f0-49c9-45c9-963a-1a8870d1dce6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.347886 Nov 02 16:47:16.107181 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-809eedb6-6056-4e41-afd7-dac9ca3ba920 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:16.111239 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 54/93] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:15 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:16.111468 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-809eedb6-6056-4e41-afd7-dac9ca3ba920 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:16.112431 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-809eedb6-6056-4e41-afd7-dac9ca3ba920 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:16.113012 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-809eedb6-6056-4e41-afd7-dac9ca3ba920 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:16.336570 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fe070f7b-bf50-4369-b872-8c6b85f850c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:16.337232 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fe070f7b-bf50-4369-b872-8c6b85f850c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:16.355952 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fe070f7b-bf50-4369-b872-8c6b85f850c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:16.357079 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fe070f7b-bf50-4369-b872-8c6b85f850c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:16.358250 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fe070f7b-bf50-4369-b872-8c6b85f850c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:16.358900 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fe070f7b-bf50-4369-b872-8c6b85f850c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:17.121434 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-fe070f7b-bf50-4369-b872-8c6b85f850c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:17.150568 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-fe070f7b-bf50-4369-b872-8c6b85f850c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:17.152944 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-fe070f7b-bf50-4369-b872-8c6b85f850c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:17.159416 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fe070f7b-bf50-4369-b872-8c6b85f850c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.831665 Nov 02 16:47:17.164275 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 55/94] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:16 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:47:17.165573 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-809eedb6-6056-4e41-afd7-dac9ca3ba920 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:17.175607 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-60bfa6c2-8d97-435b-9d65-0710e1706a43 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:17.185698 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-60bfa6c2-8d97-435b-9d65-0710e1706a43 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:17.207489 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-60bfa6c2-8d97-435b-9d65-0710e1706a43 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:17.209506 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-60bfa6c2-8d97-435b-9d65-0710e1706a43 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:17.213570 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-60bfa6c2-8d97-435b-9d65-0710e1706a43 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:17.214411 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-60bfa6c2-8d97-435b-9d65-0710e1706a43 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:17.214538 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-809eedb6-6056-4e41-afd7-dac9ca3ba920 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 1.146539 Nov 02 16:47:17.215667 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 40/95] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:16 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:17.258893 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-24465290-c4a2-4134-9df5-c0125690ad94 req-58be0751-4a7c-400d-a078-6242a7021e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df0bde8-504d-42f2-b162-1fb601b26528", "tag": "6a36918e-caa7-42ed-b923-c3a049049148"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:17.273126 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:47:17.273126 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:47:17.310669 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-24465290-c4a2-4134-9df5-c0125690ad94 req-58be0751-4a7c-400d-a078-6242a7021e82 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:17.315216 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-24465290-c4a2-4134-9df5-c0125690ad94 req-58be0751-4a7c-400d-a078-6242a7021e82 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:17.361355 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-24465290-c4a2-4134-9df5-c0125690ad94 req-58be0751-4a7c-400d-a078-6242a7021e82 service nova] Creating event network-changed:6a36918e-caa7-42ed-b923-c3a049049148 for instance 3df0bde8-504d-42f2-b162-1fb601b26528 on hv-cinder-77387 Nov 02 16:47:17.373411 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-24465290-c4a2-4134-9df5-c0125690ad94 req-58be0751-4a7c-400d-a078-6242a7021e82 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142470 Nov 02 16:47:17.374784 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 41/96] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:47:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:17.384107 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-31735475-641e-43f7-adec-9fd8f00cd2a5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:17.385167 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-31735475-641e-43f7-adec-9fd8f00cd2a5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:17.397849 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-31735475-641e-43f7-adec-9fd8f00cd2a5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:17.398704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-31735475-641e-43f7-adec-9fd8f00cd2a5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:17.399868 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-31735475-641e-43f7-adec-9fd8f00cd2a5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:17.400916 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-31735475-641e-43f7-adec-9fd8f00cd2a5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:17.656528 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-60bfa6c2-8d97-435b-9d65-0710e1706a43 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:17.680081 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-60bfa6c2-8d97-435b-9d65-0710e1706a43 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.513730 Nov 02 16:47:17.682838 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 56/97] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:17 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:17.705852 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-aa169929-7a22-4912-9cc2-c7dfdc1d65fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:17.707208 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-aa169929-7a22-4912-9cc2-c7dfdc1d65fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:17.738156 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-aa169929-7a22-4912-9cc2-c7dfdc1d65fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:17.739178 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-aa169929-7a22-4912-9cc2-c7dfdc1d65fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:17.741450 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-aa169929-7a22-4912-9cc2-c7dfdc1d65fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:17.742094 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-aa169929-7a22-4912-9cc2-c7dfdc1d65fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:18.012940 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-aa169929-7a22-4912-9cc2-c7dfdc1d65fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:18.023760 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-aa169929-7a22-4912-9cc2-c7dfdc1d65fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.338449 Nov 02 16:47:18.024818 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 57/98] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:17 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:18.032909 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-ce49cf4b-d153-4554-9af0-3f87eb853b37 req-769d4346-0ff1-4d1c-9e4f-80638e4b7ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0809e6-a338-4bc7-8413-86af16333eb4", "tag": "8f7b9d28-8f61-494a-88cb-4fc30ad64a7e"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:18.034928 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:47:18.034928 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:47:18.041048 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-31735475-641e-43f7-adec-9fd8f00cd2a5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:18.046184 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-ce49cf4b-d153-4554-9af0-3f87eb853b37 req-769d4346-0ff1-4d1c-9e4f-80638e4b7ab0 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:18.047063 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-ce49cf4b-d153-4554-9af0-3f87eb853b37 req-769d4346-0ff1-4d1c-9e4f-80638e4b7ab0 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:18.057196 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-31735475-641e-43f7-adec-9fd8f00cd2a5 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.678818 Nov 02 16:47:18.059810 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 42/99] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:17 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:18.069087 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-ce49cf4b-d153-4554-9af0-3f87eb853b37 req-769d4346-0ff1-4d1c-9e4f-80638e4b7ab0 service nova] Creating event network-changed:8f7b9d28-8f61-494a-88cb-4fc30ad64a7e for instance 1e0809e6-a338-4bc7-8413-86af16333eb4 on hv-cinder-77387 Nov 02 16:47:18.075856 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-ce49cf4b-d153-4554-9af0-3f87eb853b37 req-769d4346-0ff1-4d1c-9e4f-80638e4b7ab0 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049285 Nov 02 16:47:18.076641 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 58/100] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:47:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:18.187072 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3f7e39c8-2894-4f86-9ce8-52a835769a51 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:18.195033 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3f7e39c8-2894-4f86-9ce8-52a835769a51 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:18.200348 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3f7e39c8-2894-4f86-9ce8-52a835769a51 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:18.200841 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3f7e39c8-2894-4f86-9ce8-52a835769a51 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:18.201748 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3f7e39c8-2894-4f86-9ce8-52a835769a51 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:18.202201 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3f7e39c8-2894-4f86-9ce8-52a835769a51 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:18.234094 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e1d777a7-2fc6-4ad3-832a-df468e0f7149 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:18.235091 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e1d777a7-2fc6-4ad3-832a-df468e0f7149 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:18.251263 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e1d777a7-2fc6-4ad3-832a-df468e0f7149 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:18.251809 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e1d777a7-2fc6-4ad3-832a-df468e0f7149 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:18.252690 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e1d777a7-2fc6-4ad3-832a-df468e0f7149 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:18.253130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e1d777a7-2fc6-4ad3-832a-df468e0f7149 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:18.422358 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3f7e39c8-2894-4f86-9ce8-52a835769a51 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:18.441063 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3f7e39c8-2894-4f86-9ce8-52a835769a51 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:18.444882 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3f7e39c8-2894-4f86-9ce8-52a835769a51 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:18.447222 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3f7e39c8-2894-4f86-9ce8-52a835769a51 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.265885 Nov 02 16:47:18.448416 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 43/101] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:18 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:18.465742 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e1d777a7-2fc6-4ad3-832a-df468e0f7149 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:18.476106 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e1d777a7-2fc6-4ad3-832a-df468e0f7149 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.246545 Nov 02 16:47:18.476856 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 59/102] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:18 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:18.717280 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e7863bea-7c08-46ec-8aab-8aca5655c0c5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:18.718481 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e7863bea-7c08-46ec-8aab-8aca5655c0c5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:18.738883 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e7863bea-7c08-46ec-8aab-8aca5655c0c5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:18.742328 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e7863bea-7c08-46ec-8aab-8aca5655c0c5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:18.745003 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e7863bea-7c08-46ec-8aab-8aca5655c0c5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:18.746193 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e7863bea-7c08-46ec-8aab-8aca5655c0c5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:18.996550 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e7863bea-7c08-46ec-8aab-8aca5655c0c5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:19.010298 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e7863bea-7c08-46ec-8aab-8aca5655c0c5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.300501 Nov 02 16:47:19.011179 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 44/103] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:18 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:19.043358 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e359e381-90ba-43a9-8d72-b150c7c1c004 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:19.044007 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e359e381-90ba-43a9-8d72-b150c7c1c004 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:19.051361 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e359e381-90ba-43a9-8d72-b150c7c1c004 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:19.051827 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e359e381-90ba-43a9-8d72-b150c7c1c004 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:19.053844 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e359e381-90ba-43a9-8d72-b150c7c1c004 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:19.054312 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e359e381-90ba-43a9-8d72-b150c7c1c004 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:19.080615 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b3bccf60-5b25-47e1-85db-772f0a4c3e6f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:19.082357 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b3bccf60-5b25-47e1-85db-772f0a4c3e6f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:19.091387 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b3bccf60-5b25-47e1-85db-772f0a4c3e6f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:19.092228 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b3bccf60-5b25-47e1-85db-772f0a4c3e6f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:19.093444 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b3bccf60-5b25-47e1-85db-772f0a4c3e6f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:19.094158 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b3bccf60-5b25-47e1-85db-772f0a4c3e6f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:19.289053 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e359e381-90ba-43a9-8d72-b150c7c1c004 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:19.298365 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e359e381-90ba-43a9-8d72-b150c7c1c004 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.259500 Nov 02 16:47:19.299036 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 60/104] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:19 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:19.340689 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b3bccf60-5b25-47e1-85db-772f0a4c3e6f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:19.351000 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b3bccf60-5b25-47e1-85db-772f0a4c3e6f tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.277824 Nov 02 16:47:19.351941 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 45/105] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:19 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:19.482416 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e0362fed-c7ad-4983-8684-10c7da777e88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:19.483582 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e0362fed-c7ad-4983-8684-10c7da777e88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:19.495765 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e0362fed-c7ad-4983-8684-10c7da777e88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:19.496760 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e0362fed-c7ad-4983-8684-10c7da777e88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:19.497064 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-32960200-17ab-4fca-89f2-e9d272d678e7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:19.497992 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-32960200-17ab-4fca-89f2-e9d272d678e7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:19.498215 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e0362fed-c7ad-4983-8684-10c7da777e88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:19.498729 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e0362fed-c7ad-4983-8684-10c7da777e88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:19.507558 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-32960200-17ab-4fca-89f2-e9d272d678e7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:19.508497 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-32960200-17ab-4fca-89f2-e9d272d678e7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:19.509723 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-32960200-17ab-4fca-89f2-e9d272d678e7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:19.510179 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-32960200-17ab-4fca-89f2-e9d272d678e7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:19.736488 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e0362fed-c7ad-4983-8684-10c7da777e88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:19.756163 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-32960200-17ab-4fca-89f2-e9d272d678e7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:19.757564 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e0362fed-c7ad-4983-8684-10c7da777e88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:19.761673 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e0362fed-c7ad-4983-8684-10c7da777e88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:19.764061 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e0362fed-c7ad-4983-8684-10c7da777e88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.290195 Nov 02 16:47:19.765281 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 61/106] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:19 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:19.767734 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-32960200-17ab-4fca-89f2-e9d272d678e7 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.275044 Nov 02 16:47:19.768649 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 46/107] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:19 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:20.038563 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a9f1c775-57af-4840-ba77-c90d444cffee tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:20.040168 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a9f1c775-57af-4840-ba77-c90d444cffee tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:20.049765 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a9f1c775-57af-4840-ba77-c90d444cffee tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:20.050357 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a9f1c775-57af-4840-ba77-c90d444cffee tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:20.051519 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a9f1c775-57af-4840-ba77-c90d444cffee tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:20.052652 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a9f1c775-57af-4840-ba77-c90d444cffee tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:20.332058 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d0775ca6-6379-41ea-a1c1-a2bf6e14670a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:20.334731 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d0775ca6-6379-41ea-a1c1-a2bf6e14670a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:20.350997 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0775ca6-6379-41ea-a1c1-a2bf6e14670a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:20.352234 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0775ca6-6379-41ea-a1c1-a2bf6e14670a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:20.352499 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0775ca6-6379-41ea-a1c1-a2bf6e14670a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:20.353047 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0775ca6-6379-41ea-a1c1-a2bf6e14670a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:20.707883 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a9f1c775-57af-4840-ba77-c90d444cffee tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:20.731951 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a9f1c775-57af-4840-ba77-c90d444cffee tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.700040 Nov 02 16:47:20.734786 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 62/108] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:20 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:20.756791 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-cee16b0d-11ce-4d17-8ab0-1a831e2cd7d8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:20.758125 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-cee16b0d-11ce-4d17-8ab0-1a831e2cd7d8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:20.804900 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cee16b0d-11ce-4d17-8ab0-1a831e2cd7d8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:20.806101 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cee16b0d-11ce-4d17-8ab0-1a831e2cd7d8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:20.807929 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cee16b0d-11ce-4d17-8ab0-1a831e2cd7d8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:20.809643 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cee16b0d-11ce-4d17-8ab0-1a831e2cd7d8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:20.955669 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d0775ca6-6379-41ea-a1c1-a2bf6e14670a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:20.968407 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d0775ca6-6379-41ea-a1c1-a2bf6e14670a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.641235 Nov 02 16:47:20.972733 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 47/109] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:20 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:20.981084 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e12d614b-81cb-41ec-91ea-0f52889e15e8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:20.993323 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e12d614b-81cb-41ec-91ea-0f52889e15e8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:21.035453 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e12d614b-81cb-41ec-91ea-0f52889e15e8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:21.038212 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e12d614b-81cb-41ec-91ea-0f52889e15e8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:21.040466 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e12d614b-81cb-41ec-91ea-0f52889e15e8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:21.043498 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e12d614b-81cb-41ec-91ea-0f52889e15e8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:21.502959 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e12d614b-81cb-41ec-91ea-0f52889e15e8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:21.521978 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e12d614b-81cb-41ec-91ea-0f52889e15e8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.544908 Nov 02 16:47:21.539918 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 48/110] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:20 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:21.549374 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5c36fef9-8321-45dd-a7be-faf6e8eb99c1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:21.551502 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5c36fef9-8321-45dd-a7be-faf6e8eb99c1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:21.577312 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5c36fef9-8321-45dd-a7be-faf6e8eb99c1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:21.578865 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5c36fef9-8321-45dd-a7be-faf6e8eb99c1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:21.579811 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5c36fef9-8321-45dd-a7be-faf6e8eb99c1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:21.581071 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5c36fef9-8321-45dd-a7be-faf6e8eb99c1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:21.620522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-cee16b0d-11ce-4d17-8ab0-1a831e2cd7d8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:21.647221 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-cee16b0d-11ce-4d17-8ab0-1a831e2cd7d8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.909720 Nov 02 16:47:21.647815 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 63/111] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:20 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:21.760452 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-eb7a9be2-05b0-476d-b2dc-6e950d2d4f8d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:21.762050 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-eb7a9be2-05b0-476d-b2dc-6e950d2d4f8d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:21.776558 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-eb7a9be2-05b0-476d-b2dc-6e950d2d4f8d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:21.777651 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-eb7a9be2-05b0-476d-b2dc-6e950d2d4f8d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:21.779833 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-eb7a9be2-05b0-476d-b2dc-6e950d2d4f8d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:21.780861 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-eb7a9be2-05b0-476d-b2dc-6e950d2d4f8d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:22.026998 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5c36fef9-8321-45dd-a7be-faf6e8eb99c1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:22.040758 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5c36fef9-8321-45dd-a7be-faf6e8eb99c1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:22.043141 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-eb7a9be2-05b0-476d-b2dc-6e950d2d4f8d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:22.043447 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5c36fef9-8321-45dd-a7be-faf6e8eb99c1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:22.045381 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5c36fef9-8321-45dd-a7be-faf6e8eb99c1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.503312 Nov 02 16:47:22.046411 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 49/112] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:21 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:22.055432 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0fcbc2a2-31d3-4706-940b-e364f3e4032c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:22.057340 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0fcbc2a2-31d3-4706-940b-e364f3e4032c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:22.058717 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-eb7a9be2-05b0-476d-b2dc-6e950d2d4f8d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.307609 Nov 02 16:47:22.060155 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 64/113] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:21 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:22.066859 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0fcbc2a2-31d3-4706-940b-e364f3e4032c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:22.067943 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0fcbc2a2-31d3-4706-940b-e364f3e4032c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:22.069595 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0fcbc2a2-31d3-4706-940b-e364f3e4032c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:22.070272 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0fcbc2a2-31d3-4706-940b-e364f3e4032c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:22.319234 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0fcbc2a2-31d3-4706-940b-e364f3e4032c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:22.335709 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0fcbc2a2-31d3-4706-940b-e364f3e4032c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.286578 Nov 02 16:47:22.339026 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 50/114] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:22 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:22.546635 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3d1e428c-9540-4ed9-aba1-c1f352d301f4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:22.547480 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3d1e428c-9540-4ed9-aba1-c1f352d301f4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:22.555300 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3d1e428c-9540-4ed9-aba1-c1f352d301f4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:22.555792 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3d1e428c-9540-4ed9-aba1-c1f352d301f4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:22.558982 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3d1e428c-9540-4ed9-aba1-c1f352d301f4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:22.559577 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3d1e428c-9540-4ed9-aba1-c1f352d301f4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:22.666343 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2d8fdd0a-6994-4b37-bce4-dd411a3cd295 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:22.667336 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2d8fdd0a-6994-4b37-bce4-dd411a3cd295 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:22.675516 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2d8fdd0a-6994-4b37-bce4-dd411a3cd295 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:22.675800 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2d8fdd0a-6994-4b37-bce4-dd411a3cd295 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:22.676695 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2d8fdd0a-6994-4b37-bce4-dd411a3cd295 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:22.677783 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2d8fdd0a-6994-4b37-bce4-dd411a3cd295 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:22.763580 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3d1e428c-9540-4ed9-aba1-c1f352d301f4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:22.773273 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3d1e428c-9540-4ed9-aba1-c1f352d301f4 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.230859 Nov 02 16:47:22.773984 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 65/115] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:22 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:22.861637 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2d8fdd0a-6994-4b37-bce4-dd411a3cd295 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:22.871906 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2d8fdd0a-6994-4b37-bce4-dd411a3cd295 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.210286 Nov 02 16:47:22.872638 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 51/116] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:22 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:23.064281 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6136b0fa-1e05-4403-8b05-8572498ad89e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:23.064941 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6136b0fa-1e05-4403-8b05-8572498ad89e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:23.073846 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6136b0fa-1e05-4403-8b05-8572498ad89e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:23.074317 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6136b0fa-1e05-4403-8b05-8572498ad89e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:23.075210 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6136b0fa-1e05-4403-8b05-8572498ad89e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:23.075693 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6136b0fa-1e05-4403-8b05-8572498ad89e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:23.088914 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-133dd5df-bd0e-46fa-a84c-42b08912913d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:23.090109 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-133dd5df-bd0e-46fa-a84c-42b08912913d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:23.097496 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-133dd5df-bd0e-46fa-a84c-42b08912913d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:23.097964 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-133dd5df-bd0e-46fa-a84c-42b08912913d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:23.099418 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-133dd5df-bd0e-46fa-a84c-42b08912913d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:23.100045 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-133dd5df-bd0e-46fa-a84c-42b08912913d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:23.269755 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6136b0fa-1e05-4403-8b05-8572498ad89e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:23.282663 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-133dd5df-bd0e-46fa-a84c-42b08912913d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:23.283262 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6136b0fa-1e05-4403-8b05-8572498ad89e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:23.286941 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6136b0fa-1e05-4403-8b05-8572498ad89e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:23.288985 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6136b0fa-1e05-4403-8b05-8572498ad89e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.228688 Nov 02 16:47:23.289670 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 66/117] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:23 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:23.293658 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-133dd5df-bd0e-46fa-a84c-42b08912913d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.211646 Nov 02 16:47:23.293658 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 52/118] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:23 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:23.355412 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-381ee055-fdd6-40af-b659-6d8ee88e7e70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:23.356056 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-381ee055-fdd6-40af-b659-6d8ee88e7e70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:23.364502 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-381ee055-fdd6-40af-b659-6d8ee88e7e70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:23.365286 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-381ee055-fdd6-40af-b659-6d8ee88e7e70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:23.366335 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-381ee055-fdd6-40af-b659-6d8ee88e7e70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:23.366786 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-381ee055-fdd6-40af-b659-6d8ee88e7e70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:23.523859 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-381ee055-fdd6-40af-b659-6d8ee88e7e70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:23.535459 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-381ee055-fdd6-40af-b659-6d8ee88e7e70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.184221 Nov 02 16:47:23.536209 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 67/119] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:23 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:23.793269 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ae31213b-fc33-411c-8153-2a6d46f1ebfd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:23.794608 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ae31213b-fc33-411c-8153-2a6d46f1ebfd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:23.803621 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ae31213b-fc33-411c-8153-2a6d46f1ebfd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:23.804352 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ae31213b-fc33-411c-8153-2a6d46f1ebfd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:23.805334 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ae31213b-fc33-411c-8153-2a6d46f1ebfd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:23.805924 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ae31213b-fc33-411c-8153-2a6d46f1ebfd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:23.896924 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-39dcff0d-ffb4-4a0f-afb6-4af4b645b0c8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:23.899446 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-39dcff0d-ffb4-4a0f-afb6-4af4b645b0c8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:23.910820 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-39dcff0d-ffb4-4a0f-afb6-4af4b645b0c8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:23.911754 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-39dcff0d-ffb4-4a0f-afb6-4af4b645b0c8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:23.913569 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-39dcff0d-ffb4-4a0f-afb6-4af4b645b0c8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:23.914358 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-39dcff0d-ffb4-4a0f-afb6-4af4b645b0c8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:23.993018 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ae31213b-fc33-411c-8153-2a6d46f1ebfd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:24.001491 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ae31213b-fc33-411c-8153-2a6d46f1ebfd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.213598 Nov 02 16:47:24.002152 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 53/120] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:23 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:24.089009 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-39dcff0d-ffb4-4a0f-afb6-4af4b645b0c8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:24.098038 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-39dcff0d-ffb4-4a0f-afb6-4af4b645b0c8 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.209843 Nov 02 16:47:24.099601 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 68/121] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:23 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:24.310831 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-08c4d34c-471c-43a6-9391-a4071bc673a1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:24.311468 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-08c4d34c-471c-43a6-9391-a4071bc673a1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:24.317310 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-82b49ac3-7e52-43dd-b98d-d533da46da62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:24.318166 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-82b49ac3-7e52-43dd-b98d-d533da46da62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:24.321451 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-08c4d34c-471c-43a6-9391-a4071bc673a1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:24.321973 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-08c4d34c-471c-43a6-9391-a4071bc673a1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:24.322799 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-08c4d34c-471c-43a6-9391-a4071bc673a1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:24.323256 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-08c4d34c-471c-43a6-9391-a4071bc673a1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:24.330460 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-82b49ac3-7e52-43dd-b98d-d533da46da62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:24.330963 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-82b49ac3-7e52-43dd-b98d-d533da46da62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:24.331815 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-82b49ac3-7e52-43dd-b98d-d533da46da62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:24.332292 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-82b49ac3-7e52-43dd-b98d-d533da46da62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:24.495588 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-08c4d34c-471c-43a6-9391-a4071bc673a1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:24.504286 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-08c4d34c-471c-43a6-9391-a4071bc673a1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.197471 Nov 02 16:47:24.505581 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 54/122] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:24 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:24.508917 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-82b49ac3-7e52-43dd-b98d-d533da46da62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:24.518862 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-82b49ac3-7e52-43dd-b98d-d533da46da62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:24.520501 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-82b49ac3-7e52-43dd-b98d-d533da46da62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:24.522533 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-82b49ac3-7e52-43dd-b98d-d533da46da62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.209503 Nov 02 16:47:24.523176 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 69/123] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:24 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:24.558280 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6db2c957-2cd0-436b-97f8-3ed1f4a57e3a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:24.558961 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6db2c957-2cd0-436b-97f8-3ed1f4a57e3a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:24.566039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6db2c957-2cd0-436b-97f8-3ed1f4a57e3a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:24.566572 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6db2c957-2cd0-436b-97f8-3ed1f4a57e3a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:24.568035 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6db2c957-2cd0-436b-97f8-3ed1f4a57e3a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:24.568570 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6db2c957-2cd0-436b-97f8-3ed1f4a57e3a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:24.774397 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6db2c957-2cd0-436b-97f8-3ed1f4a57e3a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:24.785413 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6db2c957-2cd0-436b-97f8-3ed1f4a57e3a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.231140 Nov 02 16:47:24.786814 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 55/124] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:24 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:25.032345 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8bcce37e-5ac2-4496-a443-f6ba39aa0c3f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:25.033415 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8bcce37e-5ac2-4496-a443-f6ba39aa0c3f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:25.047873 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8bcce37e-5ac2-4496-a443-f6ba39aa0c3f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:25.048799 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8bcce37e-5ac2-4496-a443-f6ba39aa0c3f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:25.050638 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8bcce37e-5ac2-4496-a443-f6ba39aa0c3f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:25.051499 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8bcce37e-5ac2-4496-a443-f6ba39aa0c3f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:25.117805 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-db3421b1-8e9b-4be5-9da5-abd71537c45c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:25.119510 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-db3421b1-8e9b-4be5-9da5-abd71537c45c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:25.131327 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-db3421b1-8e9b-4be5-9da5-abd71537c45c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:25.132409 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-db3421b1-8e9b-4be5-9da5-abd71537c45c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:25.133704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-db3421b1-8e9b-4be5-9da5-abd71537c45c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:25.134701 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-db3421b1-8e9b-4be5-9da5-abd71537c45c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:25.355407 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8bcce37e-5ac2-4496-a443-f6ba39aa0c3f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:25.367601 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8bcce37e-5ac2-4496-a443-f6ba39aa0c3f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.342590 Nov 02 16:47:25.368471 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 70/125] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:25 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:25.426527 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-db3421b1-8e9b-4be5-9da5-abd71537c45c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:25.437069 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-db3421b1-8e9b-4be5-9da5-abd71537c45c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.324061 Nov 02 16:47:25.437747 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 56/126] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:25 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:25.523639 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f54ad736-6d32-464e-90f7-24b973bb7bcf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:25.524503 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f54ad736-6d32-464e-90f7-24b973bb7bcf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:25.532638 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f54ad736-6d32-464e-90f7-24b973bb7bcf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:25.533110 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f54ad736-6d32-464e-90f7-24b973bb7bcf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:25.533936 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f54ad736-6d32-464e-90f7-24b973bb7bcf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:25.534372 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f54ad736-6d32-464e-90f7-24b973bb7bcf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:25.542241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e3969028-f493-4fd0-8e5a-3e719a3e6aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:25.542911 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e3969028-f493-4fd0-8e5a-3e719a3e6aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:25.553745 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e3969028-f493-4fd0-8e5a-3e719a3e6aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:25.554603 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e3969028-f493-4fd0-8e5a-3e719a3e6aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:25.555958 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e3969028-f493-4fd0-8e5a-3e719a3e6aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:25.556745 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e3969028-f493-4fd0-8e5a-3e719a3e6aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:25.731869 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f54ad736-6d32-464e-90f7-24b973bb7bcf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:25.747950 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f54ad736-6d32-464e-90f7-24b973bb7bcf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.228545 Nov 02 16:47:25.757967 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 71/127] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:25 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:25.781096 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e3969028-f493-4fd0-8e5a-3e719a3e6aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:25.797400 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e3969028-f493-4fd0-8e5a-3e719a3e6aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:25.800100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e3969028-f493-4fd0-8e5a-3e719a3e6aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:25.802192 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e3969028-f493-4fd0-8e5a-3e719a3e6aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.263800 Nov 02 16:47:25.803661 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 57/128] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:25 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:47:25.814110 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bd8f65c6-e2ea-4ffb-a9ef-8da7e87357a3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:25.815089 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-bd8f65c6-e2ea-4ffb-a9ef-8da7e87357a3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:25.834491 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bd8f65c6-e2ea-4ffb-a9ef-8da7e87357a3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:25.835889 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bd8f65c6-e2ea-4ffb-a9ef-8da7e87357a3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:25.837852 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bd8f65c6-e2ea-4ffb-a9ef-8da7e87357a3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:25.837852 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bd8f65c6-e2ea-4ffb-a9ef-8da7e87357a3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:26.159566 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-bd8f65c6-e2ea-4ffb-a9ef-8da7e87357a3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:26.186280 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-bd8f65c6-e2ea-4ffb-a9ef-8da7e87357a3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.382405 Nov 02 16:47:26.188072 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 72/129] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:25 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:26.395124 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7b9cc4f0-5ecc-4c7d-a464-0cc3a847ecf9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:26.396250 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7b9cc4f0-5ecc-4c7d-a464-0cc3a847ecf9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:26.409375 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7b9cc4f0-5ecc-4c7d-a464-0cc3a847ecf9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:26.412169 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7b9cc4f0-5ecc-4c7d-a464-0cc3a847ecf9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:26.414323 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7b9cc4f0-5ecc-4c7d-a464-0cc3a847ecf9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:26.415837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7b9cc4f0-5ecc-4c7d-a464-0cc3a847ecf9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:26.467775 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8a281f34-ba11-44ba-82d3-10feeb2a4844 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:26.469581 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8a281f34-ba11-44ba-82d3-10feeb2a4844 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:26.499815 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8a281f34-ba11-44ba-82d3-10feeb2a4844 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:26.501968 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8a281f34-ba11-44ba-82d3-10feeb2a4844 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:26.511001 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8a281f34-ba11-44ba-82d3-10feeb2a4844 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:26.512006 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8a281f34-ba11-44ba-82d3-10feeb2a4844 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:26.788528 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7b9cc4f0-5ecc-4c7d-a464-0cc3a847ecf9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:26.803892 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7b9cc4f0-5ecc-4c7d-a464-0cc3a847ecf9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.413789 Nov 02 16:47:26.805485 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 58/130] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:26 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:26.812334 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d874be59-720a-40e8-bf8d-076df755e221 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:26.814552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d874be59-720a-40e8-bf8d-076df755e221 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:26.842807 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d874be59-720a-40e8-bf8d-076df755e221 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:26.843430 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d874be59-720a-40e8-bf8d-076df755e221 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:26.844144 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d874be59-720a-40e8-bf8d-076df755e221 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:26.846901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d874be59-720a-40e8-bf8d-076df755e221 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:26.878576 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8a281f34-ba11-44ba-82d3-10feeb2a4844 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:26.898404 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8a281f34-ba11-44ba-82d3-10feeb2a4844 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.444536 Nov 02 16:47:26.914292 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 73/131] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:26 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:26.936310 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f187a59f-3a65-4af1-a7d5-34cc6f85261c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:26.938436 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f187a59f-3a65-4af1-a7d5-34cc6f85261c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:26.953547 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f187a59f-3a65-4af1-a7d5-34cc6f85261c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:26.955757 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f187a59f-3a65-4af1-a7d5-34cc6f85261c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:26.959196 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f187a59f-3a65-4af1-a7d5-34cc6f85261c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:26.960082 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f187a59f-3a65-4af1-a7d5-34cc6f85261c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:27.149716 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d874be59-720a-40e8-bf8d-076df755e221 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:27.160420 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d874be59-720a-40e8-bf8d-076df755e221 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.353244 Nov 02 16:47:27.168962 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 59/132] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:26 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:27.217858 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6dd421af-42d0-4def-878c-af6fcdd5bd39 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:27.218988 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6dd421af-42d0-4def-878c-af6fcdd5bd39 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:27.228737 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6dd421af-42d0-4def-878c-af6fcdd5bd39 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:27.229796 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6dd421af-42d0-4def-878c-af6fcdd5bd39 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:27.230991 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6dd421af-42d0-4def-878c-af6fcdd5bd39 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:27.231832 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6dd421af-42d0-4def-878c-af6fcdd5bd39 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:27.394155 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f187a59f-3a65-4af1-a7d5-34cc6f85261c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:27.409943 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f187a59f-3a65-4af1-a7d5-34cc6f85261c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:27.412717 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f187a59f-3a65-4af1-a7d5-34cc6f85261c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:27.415918 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f187a59f-3a65-4af1-a7d5-34cc6f85261c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.498669 Nov 02 16:47:27.418490 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 74/133] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:26 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:27.532934 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6dd421af-42d0-4def-878c-af6fcdd5bd39 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:27.549500 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6dd421af-42d0-4def-878c-af6fcdd5bd39 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.334259 Nov 02 16:47:27.550505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 60/134] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:27 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:27.816887 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-cba8aef6-56a9-4a5e-bcb6-a332733319fc req-32b27ac3-82ca-4291-8000-264fc77d8b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5b406e-d37d-44b0-bb2f-39532baf3f9e", "name": "network-vif-plugged", "status": "completed", "tag": "8c95a943-ceda-4a49-8043-1035f5d14c4a"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:27.821381 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:47:27.821381 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:47:27.828003 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-93881752-fdd2-4cae-a7ca-63b7fd379854 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:27.828708 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-93881752-fdd2-4cae-a7ca-63b7fd379854 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:27.836511 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-cba8aef6-56a9-4a5e-bcb6-a332733319fc req-32b27ac3-82ca-4291-8000-264fc77d8b42 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:27.836941 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-cba8aef6-56a9-4a5e-bcb6-a332733319fc req-32b27ac3-82ca-4291-8000-264fc77d8b42 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:27.842514 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-93881752-fdd2-4cae-a7ca-63b7fd379854 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:27.851089 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-93881752-fdd2-4cae-a7ca-63b7fd379854 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:27.852202 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-93881752-fdd2-4cae-a7ca-63b7fd379854 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:27.852944 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-93881752-fdd2-4cae-a7ca-63b7fd379854 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:27.917468 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-cba8aef6-56a9-4a5e-bcb6-a332733319fc req-32b27ac3-82ca-4291-8000-264fc77d8b42 service nova] Creating event network-vif-plugged:8c95a943-ceda-4a49-8043-1035f5d14c4a for instance 6e5b406e-d37d-44b0-bb2f-39532baf3f9e on hv-cinder-77387 Nov 02 16:47:27.937534 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-cba8aef6-56a9-4a5e-bcb6-a332733319fc req-32b27ac3-82ca-4291-8000-264fc77d8b42 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222956 Nov 02 16:47:27.960656 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 75/135] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:47:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:28.004859 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5c6bd684-4932-4e54-9494-fc777589fb75 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:28.008209 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5c6bd684-4932-4e54-9494-fc777589fb75 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:28.031789 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5c6bd684-4932-4e54-9494-fc777589fb75 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:28.035578 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5c6bd684-4932-4e54-9494-fc777589fb75 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:28.041090 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5c6bd684-4932-4e54-9494-fc777589fb75 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:28.041737 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5c6bd684-4932-4e54-9494-fc777589fb75 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:28.273794 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-93881752-fdd2-4cae-a7ca-63b7fd379854 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:28.307687 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-93881752-fdd2-4cae-a7ca-63b7fd379854 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.485009 Nov 02 16:47:28.315250 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 61/136] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:27 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:28.351546 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-54907862-15be-4560-9839-db3314caa2c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:28.354079 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-54907862-15be-4560-9839-db3314caa2c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:28.372296 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-54907862-15be-4560-9839-db3314caa2c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:28.373581 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-54907862-15be-4560-9839-db3314caa2c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:28.377365 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-54907862-15be-4560-9839-db3314caa2c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:28.380595 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-54907862-15be-4560-9839-db3314caa2c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:28.695195 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5c6bd684-4932-4e54-9494-fc777589fb75 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:28.715034 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5c6bd684-4932-4e54-9494-fc777589fb75 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.750151 Nov 02 16:47:28.715739 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 76/137] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:27 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:28.723412 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-49c20914-0cc2-4d20-b74f-e3012bf7811d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:28.724415 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-49c20914-0cc2-4d20-b74f-e3012bf7811d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:28.742285 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-49c20914-0cc2-4d20-b74f-e3012bf7811d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:28.745004 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-49c20914-0cc2-4d20-b74f-e3012bf7811d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:28.746579 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-49c20914-0cc2-4d20-b74f-e3012bf7811d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:28.748141 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-49c20914-0cc2-4d20-b74f-e3012bf7811d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:28.828952 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-54907862-15be-4560-9839-db3314caa2c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:28.841930 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-54907862-15be-4560-9839-db3314caa2c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.524166 Nov 02 16:47:28.846406 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 62/138] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:28 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:28.873105 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-23157d60-9945-4fad-9e55-ec6d9fde3578 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:28.874051 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-23157d60-9945-4fad-9e55-ec6d9fde3578 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:28.901402 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-23157d60-9945-4fad-9e55-ec6d9fde3578 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:28.902044 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-23157d60-9945-4fad-9e55-ec6d9fde3578 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:28.905289 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-23157d60-9945-4fad-9e55-ec6d9fde3578 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:28.905289 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-23157d60-9945-4fad-9e55-ec6d9fde3578 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:29.102190 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-49c20914-0cc2-4d20-b74f-e3012bf7811d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:29.120375 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-49c20914-0cc2-4d20-b74f-e3012bf7811d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:29.125289 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-49c20914-0cc2-4d20-b74f-e3012bf7811d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:29.128321 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-49c20914-0cc2-4d20-b74f-e3012bf7811d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.410491 Nov 02 16:47:29.129571 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 77/139] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:28 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:29.318421 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-23157d60-9945-4fad-9e55-ec6d9fde3578 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:29.345746 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bf9b48f3-8555-4728-8bfc-6643b3a09bcd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:29.348890 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-bf9b48f3-8555-4728-8bfc-6643b3a09bcd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:29.367718 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bf9b48f3-8555-4728-8bfc-6643b3a09bcd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:29.368147 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-23157d60-9945-4fad-9e55-ec6d9fde3578 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.516339 Nov 02 16:47:29.369809 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 63/140] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:28 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:29.370586 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bf9b48f3-8555-4728-8bfc-6643b3a09bcd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:29.373099 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bf9b48f3-8555-4728-8bfc-6643b3a09bcd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:29.374043 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bf9b48f3-8555-4728-8bfc-6643b3a09bcd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:29.726440 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-bf9b48f3-8555-4728-8bfc-6643b3a09bcd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:29.742927 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a56137ed-ec7a-45bd-ae01-4c43a972ba36 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:29.743485 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-bf9b48f3-8555-4728-8bfc-6643b3a09bcd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.413349 Nov 02 16:47:29.744392 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a56137ed-ec7a-45bd-ae01-4c43a972ba36 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:29.747330 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 78/141] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:29 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:29.762313 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a56137ed-ec7a-45bd-ae01-4c43a972ba36 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:29.763135 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a56137ed-ec7a-45bd-ae01-4c43a972ba36 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:29.764400 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a56137ed-ec7a-45bd-ae01-4c43a972ba36 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:29.765258 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a56137ed-ec7a-45bd-ae01-4c43a972ba36 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:29.880621 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e340d5d9-d3fb-4136-a675-032d28a424a8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:29.885454 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e340d5d9-d3fb-4136-a675-032d28a424a8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:29.906585 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e340d5d9-d3fb-4136-a675-032d28a424a8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:29.907579 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e340d5d9-d3fb-4136-a675-032d28a424a8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:29.910293 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e340d5d9-d3fb-4136-a675-032d28a424a8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:29.912362 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e340d5d9-d3fb-4136-a675-032d28a424a8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:30.187075 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a56137ed-ec7a-45bd-ae01-4c43a972ba36 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:30.204103 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a56137ed-ec7a-45bd-ae01-4c43a972ba36 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.466649 Nov 02 16:47:30.205558 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 64/142] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:29 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:30.219912 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-86589ae7-f2dc-4192-be53-39ce51ec48b3 req-75ea73dc-816b-47f8-9c4d-a33eed0c4cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72140edf-a256-42c5-96ab-aa20fadf6e0b", "name": "network-vif-plugged", "status": "completed", "tag": "9877734a-b105-41fe-bb14-bcc253387958"}, {"server_uuid": "e699b34f-97c8-4316-9e80-4820d1f94e26", "name": "network-vif-plugged", "status": "completed", "tag": "6d3bae71-e514-49ab-9222-9632d4fba0f5"}, {"server_uuid": "17da9bbd-fb82-4abe-a41e-4edac4b87bc7", "name": "network-vif-plugged", "status": "completed", "tag": "4c21c6a5-6c5e-47dc-9609-26483e9e33f3"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:30.224925 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:47:30.224925 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:47:30.242168 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-86589ae7-f2dc-4192-be53-39ce51ec48b3 req-75ea73dc-816b-47f8-9c4d-a33eed0c4cb5 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:30.242756 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-86589ae7-f2dc-4192-be53-39ce51ec48b3 req-75ea73dc-816b-47f8-9c4d-a33eed0c4cb5 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:30.284311 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e340d5d9-d3fb-4136-a675-032d28a424a8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:30.285812 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-86589ae7-f2dc-4192-be53-39ce51ec48b3 req-75ea73dc-816b-47f8-9c4d-a33eed0c4cb5 service nova] Creating event network-vif-plugged:9877734a-b105-41fe-bb14-bcc253387958 for instance 72140edf-a256-42c5-96ab-aa20fadf6e0b on hv-cinder-77387 Nov 02 16:47:30.286619 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-86589ae7-f2dc-4192-be53-39ce51ec48b3 req-75ea73dc-816b-47f8-9c4d-a33eed0c4cb5 service nova] Creating event network-vif-plugged:6d3bae71-e514-49ab-9222-9632d4fba0f5 for instance e699b34f-97c8-4316-9e80-4820d1f94e26 on hv-cinder-77387 Nov 02 16:47:30.287350 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-86589ae7-f2dc-4192-be53-39ce51ec48b3 req-75ea73dc-816b-47f8-9c4d-a33eed0c4cb5 service nova] Creating event network-vif-plugged:4c21c6a5-6c5e-47dc-9609-26483e9e33f3 for instance 17da9bbd-fb82-4abe-a41e-4edac4b87bc7 on hv-cinder-77387 Nov 02 16:47:30.297532 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-86589ae7-f2dc-4192-be53-39ce51ec48b3 req-75ea73dc-816b-47f8-9c4d-a33eed0c4cb5 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.090297 Nov 02 16:47:30.298254 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 65/143] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:47:30 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:30.300214 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e340d5d9-d3fb-4136-a675-032d28a424a8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.426361 Nov 02 16:47:30.307264 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6f0c2ffb-3df7-4e40-9546-2b2a7de30f4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:30.308598 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6f0c2ffb-3df7-4e40-9546-2b2a7de30f4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:30.314635 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 79/144] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:29 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:30.333963 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6f0c2ffb-3df7-4e40-9546-2b2a7de30f4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:30.334979 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6f0c2ffb-3df7-4e40-9546-2b2a7de30f4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:30.336198 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6f0c2ffb-3df7-4e40-9546-2b2a7de30f4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:30.336792 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6f0c2ffb-3df7-4e40-9546-2b2a7de30f4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:30.388308 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-07b92f28-6876-420b-b93d-1c789458467e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:30.389517 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-07b92f28-6876-420b-b93d-1c789458467e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:30.407382 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-07b92f28-6876-420b-b93d-1c789458467e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:30.407990 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-07b92f28-6876-420b-b93d-1c789458467e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:30.412066 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-07b92f28-6876-420b-b93d-1c789458467e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:30.412610 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-07b92f28-6876-420b-b93d-1c789458467e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:30.794400 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6f0c2ffb-3df7-4e40-9546-2b2a7de30f4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:30.809414 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6f0c2ffb-3df7-4e40-9546-2b2a7de30f4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:30.820447 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6f0c2ffb-3df7-4e40-9546-2b2a7de30f4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:30.822087 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6f0c2ffb-3df7-4e40-9546-2b2a7de30f4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.521940 Nov 02 16:47:30.822968 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 66/145] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:30 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:30.838431 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5a9fe0d7-c2a5-4527-8792-4fd1dd075311 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:30.839217 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5a9fe0d7-c2a5-4527-8792-4fd1dd075311 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:30.857951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5a9fe0d7-c2a5-4527-8792-4fd1dd075311 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:30.862408 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5a9fe0d7-c2a5-4527-8792-4fd1dd075311 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:30.863825 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5a9fe0d7-c2a5-4527-8792-4fd1dd075311 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:30.865043 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5a9fe0d7-c2a5-4527-8792-4fd1dd075311 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:31.038799 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-07b92f28-6876-420b-b93d-1c789458467e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:31.071860 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-07b92f28-6876-420b-b93d-1c789458467e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.688596 Nov 02 16:47:31.084919 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 80/146] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:30 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:31.224064 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-174ba9b4-99fa-466d-bef8-e9d5c43ee7a1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:31.224977 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-174ba9b4-99fa-466d-bef8-e9d5c43ee7a1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:31.245414 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-174ba9b4-99fa-466d-bef8-e9d5c43ee7a1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:31.245973 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-174ba9b4-99fa-466d-bef8-e9d5c43ee7a1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:31.247074 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-174ba9b4-99fa-466d-bef8-e9d5c43ee7a1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:31.247937 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-174ba9b4-99fa-466d-bef8-e9d5c43ee7a1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:31.256121 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5a9fe0d7-c2a5-4527-8792-4fd1dd075311 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:31.282199 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5a9fe0d7-c2a5-4527-8792-4fd1dd075311 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.457653 Nov 02 16:47:31.282738 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 67/147] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:30 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:31.319581 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-983b65d7-b56f-4d03-b680-bda97465c65b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:31.320274 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-983b65d7-b56f-4d03-b680-bda97465c65b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:31.344312 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-983b65d7-b56f-4d03-b680-bda97465c65b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:31.346058 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-983b65d7-b56f-4d03-b680-bda97465c65b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:31.347505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-983b65d7-b56f-4d03-b680-bda97465c65b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:31.348414 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-983b65d7-b56f-4d03-b680-bda97465c65b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:31.586646 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-983b65d7-b56f-4d03-b680-bda97465c65b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:31.596689 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-983b65d7-b56f-4d03-b680-bda97465c65b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.282032 Nov 02 16:47:31.597353 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 68/148] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:31 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:31.708447 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-174ba9b4-99fa-466d-bef8-e9d5c43ee7a1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:31.721326 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-174ba9b4-99fa-466d-bef8-e9d5c43ee7a1 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.501456 Nov 02 16:47:31.723134 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 81/149] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:31 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:31.863982 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a2849703-0d0e-4026-9920-ecd022e04996 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:31.865340 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a2849703-0d0e-4026-9920-ecd022e04996 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:31.879100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a2849703-0d0e-4026-9920-ecd022e04996 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:31.880635 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a2849703-0d0e-4026-9920-ecd022e04996 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:31.882187 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a2849703-0d0e-4026-9920-ecd022e04996 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:31.883090 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a2849703-0d0e-4026-9920-ecd022e04996 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:32.103108 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5e67e3e8-0a4a-48e1-96ac-02971e7b6021 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:32.103876 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5e67e3e8-0a4a-48e1-96ac-02971e7b6021 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:32.112002 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5e67e3e8-0a4a-48e1-96ac-02971e7b6021 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:32.112838 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5e67e3e8-0a4a-48e1-96ac-02971e7b6021 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:32.114152 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5e67e3e8-0a4a-48e1-96ac-02971e7b6021 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:32.114881 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5e67e3e8-0a4a-48e1-96ac-02971e7b6021 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:32.164004 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a2849703-0d0e-4026-9920-ecd022e04996 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:32.175976 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a2849703-0d0e-4026-9920-ecd022e04996 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:32.178497 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a2849703-0d0e-4026-9920-ecd022e04996 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:32.180237 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a2849703-0d0e-4026-9920-ecd022e04996 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.324235 Nov 02 16:47:32.182224 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 69/150] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:31 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:32.300391 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5e67e3e8-0a4a-48e1-96ac-02971e7b6021 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:32.304928 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0f3303e3-d930-4f52-a625-de4f13ce83a6 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:32.306502 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0f3303e3-d930-4f52-a625-de4f13ce83a6 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:32.315588 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0f3303e3-d930-4f52-a625-de4f13ce83a6 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:32.319719 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0f3303e3-d930-4f52-a625-de4f13ce83a6 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:32.320534 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5e67e3e8-0a4a-48e1-96ac-02971e7b6021 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.221502 Nov 02 16:47:32.320729 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0f3303e3-d930-4f52-a625-de4f13ce83a6 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:32.321393 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0f3303e3-d930-4f52-a625-de4f13ce83a6 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:32.332300 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 82/151] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:32 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:32.510331 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0f3303e3-d930-4f52-a625-de4f13ce83a6 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:32.521582 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0f3303e3-d930-4f52-a625-de4f13ce83a6 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1322 microversion: 2.1 time: 0.221608 Nov 02 16:47:32.523257 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 70/152] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:32 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:32.614823 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ad09d060-a641-43b3-b511-d31a44b570f5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:32.615807 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ad09d060-a641-43b3-b511-d31a44b570f5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:32.624640 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ad09d060-a641-43b3-b511-d31a44b570f5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:32.624974 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ad09d060-a641-43b3-b511-d31a44b570f5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:32.626140 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ad09d060-a641-43b3-b511-d31a44b570f5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:32.626769 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ad09d060-a641-43b3-b511-d31a44b570f5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:32.741577 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-423aec24-97e3-4124-aa91-89368778d8c3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:32.742377 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-423aec24-97e3-4124-aa91-89368778d8c3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:32.751806 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-423aec24-97e3-4124-aa91-89368778d8c3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:32.752508 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-423aec24-97e3-4124-aa91-89368778d8c3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:32.753458 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-423aec24-97e3-4124-aa91-89368778d8c3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:32.754025 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-423aec24-97e3-4124-aa91-89368778d8c3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:32.900607 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ad09d060-a641-43b3-b511-d31a44b570f5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:32.929728 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ad09d060-a641-43b3-b511-d31a44b570f5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1325 microversion: 2.1 time: 0.315727 Nov 02 16:47:32.941134 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 83/153] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:32 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1325 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:33.024802 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-423aec24-97e3-4124-aa91-89368778d8c3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:33.053762 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-423aec24-97e3-4124-aa91-89368778d8c3 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1319 microversion: 2.1 time: 0.316714 Nov 02 16:47:33.064903 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 71/154] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:32 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:33.201109 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f6d7ee7f-9f07-4b3c-b635-d47c13cf98d8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:33.202182 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f6d7ee7f-9f07-4b3c-b635-d47c13cf98d8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:33.211397 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f6d7ee7f-9f07-4b3c-b635-d47c13cf98d8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:33.212117 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f6d7ee7f-9f07-4b3c-b635-d47c13cf98d8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:33.213075 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f6d7ee7f-9f07-4b3c-b635-d47c13cf98d8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:33.213742 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f6d7ee7f-9f07-4b3c-b635-d47c13cf98d8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:33.319461 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-d8698ec3-aebb-45f5-9d9a-2d864a5d02de req-8a47b0be-39d2-4625-9409-fdd732e0cd87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0809e6-a338-4bc7-8413-86af16333eb4", "name": "network-vif-plugged", "status": "completed", "tag": "8f7b9d28-8f61-494a-88cb-4fc30ad64a7e"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:33.332469 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:47:33.332469 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:47:33.355886 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-d8698ec3-aebb-45f5-9d9a-2d864a5d02de req-8a47b0be-39d2-4625-9409-fdd732e0cd87 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:33.358170 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-d8698ec3-aebb-45f5-9d9a-2d864a5d02de req-8a47b0be-39d2-4625-9409-fdd732e0cd87 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:33.399685 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-d8698ec3-aebb-45f5-9d9a-2d864a5d02de req-8a47b0be-39d2-4625-9409-fdd732e0cd87 service nova] Creating event network-vif-plugged:8f7b9d28-8f61-494a-88cb-4fc30ad64a7e for instance 1e0809e6-a338-4bc7-8413-86af16333eb4 on hv-cinder-77387 Nov 02 16:47:33.417044 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-d8698ec3-aebb-45f5-9d9a-2d864a5d02de req-8a47b0be-39d2-4625-9409-fdd732e0cd87 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095802 Nov 02 16:47:33.420872 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 72/155] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:47:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:47:33.433716 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-bf168a8b-4241-4b12-8cce-f0b66531e009 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:33.438949 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-bf168a8b-4241-4b12-8cce-f0b66531e009 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:33.472315 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bf168a8b-4241-4b12-8cce-f0b66531e009 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:33.473399 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bf168a8b-4241-4b12-8cce-f0b66531e009 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:33.497561 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bf168a8b-4241-4b12-8cce-f0b66531e009 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:33.498307 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bf168a8b-4241-4b12-8cce-f0b66531e009 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:33.514502 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f6d7ee7f-9f07-4b3c-b635-d47c13cf98d8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:33.528953 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f6d7ee7f-9f07-4b3c-b635-d47c13cf98d8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:33.543328 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f6d7ee7f-9f07-4b3c-b635-d47c13cf98d8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:33.547320 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f6d7ee7f-9f07-4b3c-b635-d47c13cf98d8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.348979 Nov 02 16:47:33.553131 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 84/156] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:33 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:33.560384 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-62a8a5b7-004b-4c52-a4c6-36b0dc8924da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:33.562999 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-62a8a5b7-004b-4c52-a4c6-36b0dc8924da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:33.585484 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-62a8a5b7-004b-4c52-a4c6-36b0dc8924da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:33.604888 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-62a8a5b7-004b-4c52-a4c6-36b0dc8924da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:33.612555 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-62a8a5b7-004b-4c52-a4c6-36b0dc8924da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:33.617202 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-62a8a5b7-004b-4c52-a4c6-36b0dc8924da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:33.802541 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-bf168a8b-4241-4b12-8cce-f0b66531e009 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:33.829396 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-bf168a8b-4241-4b12-8cce-f0b66531e009 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.406688 Nov 02 16:47:33.830613 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 73/157] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:33 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:33.958524 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1c6284b4-7309-438c-bf40-9b6b0ca12274 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:33.962713 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1c6284b4-7309-438c-bf40-9b6b0ca12274 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:33.981820 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1c6284b4-7309-438c-bf40-9b6b0ca12274 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:33.984938 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1c6284b4-7309-438c-bf40-9b6b0ca12274 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:33.987676 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1c6284b4-7309-438c-bf40-9b6b0ca12274 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:33.989667 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1c6284b4-7309-438c-bf40-9b6b0ca12274 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:34.080333 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-62a8a5b7-004b-4c52-a4c6-36b0dc8924da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:34.107637 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-62a8a5b7-004b-4c52-a4c6-36b0dc8924da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1512 microversion: 2.1 time: 0.548167 Nov 02 16:47:34.108863 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 85/158] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:33 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1512 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:34.124512 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-82b42e89-adcf-47ce-970e-ea833c92673a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:34.127242 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-82b42e89-adcf-47ce-970e-ea833c92673a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:34.141746 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-82b42e89-adcf-47ce-970e-ea833c92673a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:34.142677 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-82b42e89-adcf-47ce-970e-ea833c92673a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:34.144225 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-82b42e89-adcf-47ce-970e-ea833c92673a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:34.145891 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-82b42e89-adcf-47ce-970e-ea833c92673a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:34.354590 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1c6284b4-7309-438c-bf40-9b6b0ca12274 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:34.377580 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1c6284b4-7309-438c-bf40-9b6b0ca12274 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1519 microversion: 2.1 time: 0.430433 Nov 02 16:47:34.394540 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 74/159] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:33 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1519 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:34.403552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-8fe3d4a0-9ef9-4d25-9b79-e62a6bbeace9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:34.415065 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8fe3d4a0-9ef9-4d25-9b79-e62a6bbeace9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:34.425446 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8fe3d4a0-9ef9-4d25-9b79-e62a6bbeace9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:34.426056 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8fe3d4a0-9ef9-4d25-9b79-e62a6bbeace9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:34.427807 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8fe3d4a0-9ef9-4d25-9b79-e62a6bbeace9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:34.428751 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8fe3d4a0-9ef9-4d25-9b79-e62a6bbeace9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:34.497119 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-82b42e89-adcf-47ce-970e-ea833c92673a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:34.514399 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.objects.instance [None req-8fe3d4a0-9ef9-4d25-9b79-e62a6bbeace9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lazy-loading 'flavor' on Instance uuid 17da9bbd-fb82-4abe-a41e-4edac4b87bc7 {{(pid=127648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:47:34.527862 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-82b42e89-adcf-47ce-970e-ea833c92673a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1507 microversion: 2.1 time: 0.416059 Nov 02 16:47:34.533832 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 86/160] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:34 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1507 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:34.586792 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3e823824-6c12-4a8e-a47c-6428bc0fc254 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:34.588982 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3e823824-6c12-4a8e-a47c-6428bc0fc254 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:34.608707 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3e823824-6c12-4a8e-a47c-6428bc0fc254 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:34.609176 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3e823824-6c12-4a8e-a47c-6428bc0fc254 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:34.610027 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3e823824-6c12-4a8e-a47c-6428bc0fc254 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:34.610475 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3e823824-6c12-4a8e-a47c-6428bc0fc254 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:34.797066 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-8fe3d4a0-9ef9-4d25-9b79-e62a6bbeace9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "POST /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7/action" status: 200 len: 32 microversion: 2.1 time: 0.398469 Nov 02 16:47:34.800894 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 75/161] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:34 2021] POST /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7/action => generated 32 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:34.823681 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4d80e44c-f150-4203-ac52-957e1aca59d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:34.825433 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4d80e44c-f150-4203-ac52-957e1aca59d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:34.837757 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d80e44c-f150-4203-ac52-957e1aca59d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:34.839833 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d80e44c-f150-4203-ac52-957e1aca59d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:34.841026 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d80e44c-f150-4203-ac52-957e1aca59d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:34.841677 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d80e44c-f150-4203-ac52-957e1aca59d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:34.990352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3e823824-6c12-4a8e-a47c-6428bc0fc254 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:35.005320 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3e823824-6c12-4a8e-a47c-6428bc0fc254 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:35.013945 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3e823824-6c12-4a8e-a47c-6428bc0fc254 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:35.016199 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3e823824-6c12-4a8e-a47c-6428bc0fc254 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.438434 Nov 02 16:47:35.026741 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 87/162] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:34 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:35.044744 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-de7e4ed6-bdbf-4102-8a6e-f4e29cf56de6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:35.047414 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-de7e4ed6-bdbf-4102-8a6e-f4e29cf56de6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:35.066997 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-de7e4ed6-bdbf-4102-8a6e-f4e29cf56de6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:35.067489 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-de7e4ed6-bdbf-4102-8a6e-f4e29cf56de6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:35.072996 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-de7e4ed6-bdbf-4102-8a6e-f4e29cf56de6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:35.073927 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-de7e4ed6-bdbf-4102-8a6e-f4e29cf56de6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:35.196548 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4d80e44c-f150-4203-ac52-957e1aca59d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:35.229632 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4d80e44c-f150-4203-ac52-957e1aca59d9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.421351 Nov 02 16:47:35.231481 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 76/163] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:34 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:35.485861 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-de7e4ed6-bdbf-4102-8a6e-f4e29cf56de6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:35.496869 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-de7e4ed6-bdbf-4102-8a6e-f4e29cf56de6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1365 microversion: 2.1 time: 0.467658 Nov 02 16:47:35.505454 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 88/164] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:35 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1365 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:35.520612 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-76644fca-b3e4-4228-8a77-e28ef9836f4e req-cbe92467-1928-4e31-a77b-9bb5dde0583b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df0bde8-504d-42f2-b162-1fb601b26528", "name": "network-vif-plugged", "status": "completed", "tag": "6a36918e-caa7-42ed-b923-c3a049049148"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:35.522799 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:47:35.522799 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:47:35.531273 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-76644fca-b3e4-4228-8a77-e28ef9836f4e req-cbe92467-1928-4e31-a77b-9bb5dde0583b service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:35.532040 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-76644fca-b3e4-4228-8a77-e28ef9836f4e req-cbe92467-1928-4e31-a77b-9bb5dde0583b service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:35.545655 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-76644fca-b3e4-4228-8a77-e28ef9836f4e req-cbe92467-1928-4e31-a77b-9bb5dde0583b service nova] Creating event network-vif-plugged:6a36918e-caa7-42ed-b923-c3a049049148 for instance 3df0bde8-504d-42f2-b162-1fb601b26528 on hv-cinder-77387 Nov 02 16:47:35.552703 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-76644fca-b3e4-4228-8a77-e28ef9836f4e req-cbe92467-1928-4e31-a77b-9bb5dde0583b service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036457 Nov 02 16:47:35.554294 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 77/165] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:47:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:35.884614 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a37174b4-f86c-4c97-9103-3d38b4226abd tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b70e23c7-4d67-42a2-b0c7-050a0b5ba2e5"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:35.887588 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a37174b4-f86c-4c97-9103-3d38b4226abd tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:35.898263 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a37174b4-f86c-4c97-9103-3d38b4226abd tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:35.899778 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a37174b4-f86c-4c97-9103-3d38b4226abd tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:35.902294 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a37174b4-f86c-4c97-9103-3d38b4226abd tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:35.903739 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a37174b4-f86c-4c97-9103-3d38b4226abd tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:35.969497 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cc24a2a4-0601-4f73-89a3-1212bc9bdb8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6e884ae-d8d1-4fc4-8343-52da07aabd21"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:35.976434 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-cc24a2a4-0601-4f73-89a3-1212bc9bdb8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:35.992980 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc24a2a4-0601-4f73-89a3-1212bc9bdb8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:35.994093 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc24a2a4-0601-4f73-89a3-1212bc9bdb8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:35.996555 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc24a2a4-0601-4f73-89a3-1212bc9bdb8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:36.002617 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc24a2a4-0601-4f73-89a3-1212bc9bdb8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:36.720244 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-cc24a2a4-0601-4f73-89a3-1212bc9bdb8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "POST /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.758492 Nov 02 16:47:36.722547 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 78/166] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:47:35 2021] POST /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26/os-volume_attachments => generated 194 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:36.731837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-aec58519-6b18-4439-b274-74524654d691 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:36.732738 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-aec58519-6b18-4439-b274-74524654d691 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:36.742733 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aec58519-6b18-4439-b274-74524654d691 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:36.743587 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aec58519-6b18-4439-b274-74524654d691 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:36.745966 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aec58519-6b18-4439-b274-74524654d691 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:36.747258 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aec58519-6b18-4439-b274-74524654d691 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:36.885485 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a37174b4-f86c-4c97-9103-3d38b4226abd tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "POST /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.007383 Nov 02 16:47:36.888864 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 89/167] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:47:35 2021] POST /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b/os-volume_attachments => generated 194 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:36.903056 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8ad4e859-a301-407a-8e34-ce3bb265fdf8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:36.904764 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8ad4e859-a301-407a-8e34-ce3bb265fdf8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:36.916159 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8ad4e859-a301-407a-8e34-ce3bb265fdf8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:36.916876 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8ad4e859-a301-407a-8e34-ce3bb265fdf8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:36.917969 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8ad4e859-a301-407a-8e34-ce3bb265fdf8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:36.918432 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8ad4e859-a301-407a-8e34-ce3bb265fdf8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:37.000061 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-aec58519-6b18-4439-b274-74524654d691 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:37.019724 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-aec58519-6b18-4439-b274-74524654d691 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:37.037453 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-aec58519-6b18-4439-b274-74524654d691 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:37.039420 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-aec58519-6b18-4439-b274-74524654d691 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1412 microversion: 2.20 time: 0.314448 Nov 02 16:47:37.041814 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 79/168] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:36 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1412 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:37.066284 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ff554c09-ea1e-443e-80dc-57ca99169930 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:37.068813 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ff554c09-ea1e-443e-80dc-57ca99169930 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:37.081480 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ff554c09-ea1e-443e-80dc-57ca99169930 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:37.082164 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ff554c09-ea1e-443e-80dc-57ca99169930 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:37.084067 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ff554c09-ea1e-443e-80dc-57ca99169930 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:37.085340 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ff554c09-ea1e-443e-80dc-57ca99169930 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:37.180158 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8ad4e859-a301-407a-8e34-ce3bb265fdf8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:37.192621 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8ad4e859-a301-407a-8e34-ce3bb265fdf8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.300335 Nov 02 16:47:37.194376 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 90/169] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:36 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:37.306983 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ff554c09-ea1e-443e-80dc-57ca99169930 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:37.324911 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ff554c09-ea1e-443e-80dc-57ca99169930 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1552 microversion: 2.1 time: 0.264868 Nov 02 16:47:37.326664 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 80/170] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:37 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1552 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:37.347781 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-cdf11974-9e99-445d-8e10-2768e6577fb7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:37.349262 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-cdf11974-9e99-445d-8e10-2768e6577fb7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:37.357616 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cdf11974-9e99-445d-8e10-2768e6577fb7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:37.358177 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cdf11974-9e99-445d-8e10-2768e6577fb7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:37.359209 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cdf11974-9e99-445d-8e10-2768e6577fb7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:37.359674 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cdf11974-9e99-445d-8e10-2768e6577fb7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:37.498884 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-cdf11974-9e99-445d-8e10-2768e6577fb7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156574 Nov 02 16:47:37.499570 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 91/171] 10.222.0.118 () {58 vars in 1279 bytes} [Tue Nov 2 16:47:37 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:38.070869 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-430d53a3-6ed6-4957-bbb6-c7e543d8824b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:38.071891 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-430d53a3-6ed6-4957-bbb6-c7e543d8824b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:38.098930 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-430d53a3-6ed6-4957-bbb6-c7e543d8824b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:38.099930 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-430d53a3-6ed6-4957-bbb6-c7e543d8824b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:38.100862 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-430d53a3-6ed6-4957-bbb6-c7e543d8824b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:38.101323 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-430d53a3-6ed6-4957-bbb6-c7e543d8824b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:38.213758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1683a6be-7845-4bbe-b029-fe0af008595f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:38.214677 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1683a6be-7845-4bbe-b029-fe0af008595f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:38.228535 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1683a6be-7845-4bbe-b029-fe0af008595f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:38.229371 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1683a6be-7845-4bbe-b029-fe0af008595f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:38.230510 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1683a6be-7845-4bbe-b029-fe0af008595f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:38.231177 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1683a6be-7845-4bbe-b029-fe0af008595f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:38.414392 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-430d53a3-6ed6-4957-bbb6-c7e543d8824b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:38.430287 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-430d53a3-6ed6-4957-bbb6-c7e543d8824b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:38.431998 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-430d53a3-6ed6-4957-bbb6-c7e543d8824b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:38.433383 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-430d53a3-6ed6-4957-bbb6-c7e543d8824b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1604 microversion: 2.20 time: 0.369100 Nov 02 16:47:38.435520 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 81/172] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:47:38 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1604 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:47:38.463570 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-bc26e59d-f01f-4278-a0bb-60103dd2a091 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:38.464090 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-bc26e59d-f01f-4278-a0bb-60103dd2a091 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:38.478024 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bc26e59d-f01f-4278-a0bb-60103dd2a091 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:38.478505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bc26e59d-f01f-4278-a0bb-60103dd2a091 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:38.480655 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bc26e59d-f01f-4278-a0bb-60103dd2a091 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:38.481385 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bc26e59d-f01f-4278-a0bb-60103dd2a091 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:38.611163 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-bc26e59d-f01f-4278-a0bb-60103dd2a091 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151430 Nov 02 16:47:38.618521 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 82/173] 10.222.0.118 () {60 vars in 1320 bytes} [Tue Nov 2 16:47:38 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:47:39.302997 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1683a6be-7845-4bbe-b029-fe0af008595f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:39.317732 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1683a6be-7845-4bbe-b029-fe0af008595f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 1.108555 Nov 02 16:47:39.318992 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 92/174] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:38 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:40.341422 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-01049aac-2384-4ad0-84d4-01b161c421f2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:40.344271 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-01049aac-2384-4ad0-84d4-01b161c421f2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:40.363777 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-01049aac-2384-4ad0-84d4-01b161c421f2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:40.364882 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-01049aac-2384-4ad0-84d4-01b161c421f2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:40.367230 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-01049aac-2384-4ad0-84d4-01b161c421f2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:40.368092 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-01049aac-2384-4ad0-84d4-01b161c421f2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:40.738767 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-01049aac-2384-4ad0-84d4-01b161c421f2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:40.765771 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-01049aac-2384-4ad0-84d4-01b161c421f2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.433842 Nov 02 16:47:40.781505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 83/175] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:40 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:40.783995 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c754811f-d5ad-4bc4-9531-4008c3b707b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:40.786587 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c754811f-d5ad-4bc4-9531-4008c3b707b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:40.791105 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-38478d80-40f0-4173-9b7f-948668660941 req-20694534-8813-4b46-b550-b04f9a69e6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0809e6-a338-4bc7-8413-86af16333eb4", "tag": "8f7b9d28-8f61-494a-88cb-4fc30ad64a7e"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:40.793462 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:47:40.793462 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:47:40.807666 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-38478d80-40f0-4173-9b7f-948668660941 req-20694534-8813-4b46-b550-b04f9a69e6aa service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:40.808692 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-38478d80-40f0-4173-9b7f-948668660941 req-20694534-8813-4b46-b550-b04f9a69e6aa service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:40.815410 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c754811f-d5ad-4bc4-9531-4008c3b707b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:40.816234 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c754811f-d5ad-4bc4-9531-4008c3b707b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:40.834018 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-38478d80-40f0-4173-9b7f-948668660941 req-20694534-8813-4b46-b550-b04f9a69e6aa service nova] Creating event network-changed:8f7b9d28-8f61-494a-88cb-4fc30ad64a7e for instance 1e0809e6-a338-4bc7-8413-86af16333eb4 on hv-cinder-77387 Nov 02 16:47:40.839323 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c754811f-d5ad-4bc4-9531-4008c3b707b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:40.840756 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c754811f-d5ad-4bc4-9531-4008c3b707b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:40.844780 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-38478d80-40f0-4173-9b7f-948668660941 req-20694534-8813-4b46-b550-b04f9a69e6aa service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058911 Nov 02 16:47:40.845963 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 84/176] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:47:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:40.985152 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c754811f-d5ad-4bc4-9531-4008c3b707b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.211129 Nov 02 16:47:40.986402 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 93/177] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:40 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:41.392917 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f407d511-a175-4974-8d68-4ea2055c292e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:41.394031 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f407d511-a175-4974-8d68-4ea2055c292e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:41.425070 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f407d511-a175-4974-8d68-4ea2055c292e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:41.425551 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f407d511-a175-4974-8d68-4ea2055c292e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:41.427060 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f407d511-a175-4974-8d68-4ea2055c292e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:41.434764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f407d511-a175-4974-8d68-4ea2055c292e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:41.566778 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f407d511-a175-4974-8d68-4ea2055c292e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.180089 Nov 02 16:47:41.568492 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 85/178] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:41 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:41.787107 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b7acfa95-9089-43ac-b7a6-588817821fb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:41.790018 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b7acfa95-9089-43ac-b7a6-588817821fb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:41.819745 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7acfa95-9089-43ac-b7a6-588817821fb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:41.820241 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7acfa95-9089-43ac-b7a6-588817821fb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:41.830665 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7acfa95-9089-43ac-b7a6-588817821fb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:41.831143 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7acfa95-9089-43ac-b7a6-588817821fb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:42.015203 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f2f6a319-7045-43cc-8577-24d8bf99c9fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:42.019238 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f2f6a319-7045-43cc-8577-24d8bf99c9fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:42.039597 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f2f6a319-7045-43cc-8577-24d8bf99c9fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:42.041237 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f2f6a319-7045-43cc-8577-24d8bf99c9fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:42.043208 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f2f6a319-7045-43cc-8577-24d8bf99c9fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:42.044354 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f2f6a319-7045-43cc-8577-24d8bf99c9fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:42.171587 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b7acfa95-9089-43ac-b7a6-588817821fb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:42.175595 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f2f6a319-7045-43cc-8577-24d8bf99c9fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.178800 Nov 02 16:47:42.177876 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 86/179] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:41 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:42.191623 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b7acfa95-9089-43ac-b7a6-588817821fb0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.410028 Nov 02 16:47:42.198526 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 94/180] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:41 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:42.596957 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-67753a25-b34f-483b-85b4-b154588e521a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:42.603582 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-67753a25-b34f-483b-85b4-b154588e521a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:42.625191 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67753a25-b34f-483b-85b4-b154588e521a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:42.629014 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67753a25-b34f-483b-85b4-b154588e521a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:42.632544 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67753a25-b34f-483b-85b4-b154588e521a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:42.634652 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67753a25-b34f-483b-85b4-b154588e521a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:42.888942 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-67753a25-b34f-483b-85b4-b154588e521a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.305430 Nov 02 16:47:42.895821 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 87/181] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:42 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:42.942952 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-7f8a0217-7d64-4733-8373-9e6da8d123cf req-e4246401-5f49-401f-9e0a-cac8c3699a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df0bde8-504d-42f2-b162-1fb601b26528", "tag": "6a36918e-caa7-42ed-b923-c3a049049148"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:42.966942 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:47:42.966942 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:47:42.996459 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-7f8a0217-7d64-4733-8373-9e6da8d123cf req-e4246401-5f49-401f-9e0a-cac8c3699a92 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:43.011064 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-7f8a0217-7d64-4733-8373-9e6da8d123cf req-e4246401-5f49-401f-9e0a-cac8c3699a92 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:43.091814 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-7f8a0217-7d64-4733-8373-9e6da8d123cf req-e4246401-5f49-401f-9e0a-cac8c3699a92 service nova] Creating event network-changed:6a36918e-caa7-42ed-b923-c3a049049148 for instance 3df0bde8-504d-42f2-b162-1fb601b26528 on hv-cinder-77387 Nov 02 16:47:43.136973 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-7f8a0217-7d64-4733-8373-9e6da8d123cf req-e4246401-5f49-401f-9e0a-cac8c3699a92 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191980 Nov 02 16:47:43.148664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 95/182] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:47:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:43.200564 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f0969dc2-e18b-4ea0-bea8-35732a96b162 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:43.202972 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f0969dc2-e18b-4ea0-bea8-35732a96b162 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:43.223695 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ecd6602a-cb82-494c-8d38-af932101a397 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:43.232129 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ecd6602a-cb82-494c-8d38-af932101a397 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:43.254625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f0969dc2-e18b-4ea0-bea8-35732a96b162 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:43.271204 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ecd6602a-cb82-494c-8d38-af932101a397 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:43.277475 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ecd6602a-cb82-494c-8d38-af932101a397 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:43.282295 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ecd6602a-cb82-494c-8d38-af932101a397 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:43.284157 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f0969dc2-e18b-4ea0-bea8-35732a96b162 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:43.285264 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f0969dc2-e18b-4ea0-bea8-35732a96b162 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:43.298087 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f0969dc2-e18b-4ea0-bea8-35732a96b162 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:43.309368 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ecd6602a-cb82-494c-8d38-af932101a397 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:43.525890 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f0969dc2-e18b-4ea0-bea8-35732a96b162 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.338220 Nov 02 16:47:43.530207 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 88/183] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:43 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:43.910710 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e08d694b-5c0f-4bbc-956c-2a96f9a2f648 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:43.913379 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e08d694b-5c0f-4bbc-956c-2a96f9a2f648 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:43.924613 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e08d694b-5c0f-4bbc-956c-2a96f9a2f648 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:43.925645 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e08d694b-5c0f-4bbc-956c-2a96f9a2f648 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:43.927843 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e08d694b-5c0f-4bbc-956c-2a96f9a2f648 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:43.928832 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e08d694b-5c0f-4bbc-956c-2a96f9a2f648 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:44.024825 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e08d694b-5c0f-4bbc-956c-2a96f9a2f648 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.121500 Nov 02 16:47:44.035099 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 89/184] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:43 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:44.437772 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ecd6602a-cb82-494c-8d38-af932101a397 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:44.458438 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ecd6602a-cb82-494c-8d38-af932101a397 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 1.244460 Nov 02 16:47:44.464128 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 96/185] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:43 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:44.541697 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f77d5384-6c46-4c8c-aa15-0f91015030f8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:44.542891 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f77d5384-6c46-4c8c-aa15-0f91015030f8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:44.579985 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f77d5384-6c46-4c8c-aa15-0f91015030f8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:44.581062 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f77d5384-6c46-4c8c-aa15-0f91015030f8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:44.586939 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f77d5384-6c46-4c8c-aa15-0f91015030f8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:44.600328 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f77d5384-6c46-4c8c-aa15-0f91015030f8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:44.765138 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f77d5384-6c46-4c8c-aa15-0f91015030f8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.229188 Nov 02 16:47:44.766362 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 90/186] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:44 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:45.053649 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-14d1ef28-e743-405a-b886-c2c6e0f6c371 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:45.053649 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-14d1ef28-e743-405a-b886-c2c6e0f6c371 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:45.059129 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-14d1ef28-e743-405a-b886-c2c6e0f6c371 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:45.059600 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-14d1ef28-e743-405a-b886-c2c6e0f6c371 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:45.060485 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-14d1ef28-e743-405a-b886-c2c6e0f6c371 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:45.060932 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-14d1ef28-e743-405a-b886-c2c6e0f6c371 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:45.167381 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-14d1ef28-e743-405a-b886-c2c6e0f6c371 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.123535 Nov 02 16:47:45.168640 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 97/187] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:45 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:45.481934 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0b9a27e0-9fd7-4c4d-a235-6e7d4afb78bd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:45.482853 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0b9a27e0-9fd7-4c4d-a235-6e7d4afb78bd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:45.492526 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0b9a27e0-9fd7-4c4d-a235-6e7d4afb78bd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:45.493102 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0b9a27e0-9fd7-4c4d-a235-6e7d4afb78bd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:45.494024 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0b9a27e0-9fd7-4c4d-a235-6e7d4afb78bd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:45.494708 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0b9a27e0-9fd7-4c4d-a235-6e7d4afb78bd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:45.689951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0b9a27e0-9fd7-4c4d-a235-6e7d4afb78bd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:45.704902 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0b9a27e0-9fd7-4c4d-a235-6e7d4afb78bd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.227775 Nov 02 16:47:45.706960 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 91/188] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:45 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:45.784348 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-d6e39f61-5961-459f-a25f-e3db7821da12 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:45.786012 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d6e39f61-5961-459f-a25f-e3db7821da12 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:45.794256 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d6e39f61-5961-459f-a25f-e3db7821da12 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:45.794768 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d6e39f61-5961-459f-a25f-e3db7821da12 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:45.795712 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d6e39f61-5961-459f-a25f-e3db7821da12 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:45.796281 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d6e39f61-5961-459f-a25f-e3db7821da12 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:45.934212 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-d6e39f61-5961-459f-a25f-e3db7821da12 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.152358 Nov 02 16:47:45.934212 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 98/189] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:45 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:46.182594 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3f19cfd1-d2b4-4089-82e2-7a576a001fea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:46.183763 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3f19cfd1-d2b4-4089-82e2-7a576a001fea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:46.211390 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3f19cfd1-d2b4-4089-82e2-7a576a001fea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:46.211828 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3f19cfd1-d2b4-4089-82e2-7a576a001fea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:46.212733 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3f19cfd1-d2b4-4089-82e2-7a576a001fea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:46.213405 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3f19cfd1-d2b4-4089-82e2-7a576a001fea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:46.356952 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3f19cfd1-d2b4-4089-82e2-7a576a001fea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.178578 Nov 02 16:47:46.358345 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 92/190] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:46 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:46.729975 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-04e42bf8-717b-4bdf-98c6-0871c13a26bc tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:46.731083 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-04e42bf8-717b-4bdf-98c6-0871c13a26bc tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:46.739609 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-04e42bf8-717b-4bdf-98c6-0871c13a26bc tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:46.740399 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-04e42bf8-717b-4bdf-98c6-0871c13a26bc tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:46.741520 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-04e42bf8-717b-4bdf-98c6-0871c13a26bc tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:46.742139 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-04e42bf8-717b-4bdf-98c6-0871c13a26bc tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:46.946282 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e5072bcb-b062-4c4f-b2cc-a0beef9bb5fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:46.948129 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e5072bcb-b062-4c4f-b2cc-a0beef9bb5fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:46.970935 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-04e42bf8-717b-4bdf-98c6-0871c13a26bc tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:46.974611 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e5072bcb-b062-4c4f-b2cc-a0beef9bb5fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:46.976018 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e5072bcb-b062-4c4f-b2cc-a0beef9bb5fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:46.978288 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e5072bcb-b062-4c4f-b2cc-a0beef9bb5fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:46.979026 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e5072bcb-b062-4c4f-b2cc-a0beef9bb5fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:46.986261 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-04e42bf8-717b-4bdf-98c6-0871c13a26bc tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.260499 Nov 02 16:47:46.987775 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 99/191] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:46 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:47.103875 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e5072bcb-b062-4c4f-b2cc-a0beef9bb5fb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.164521 Nov 02 16:47:47.108693 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 93/192] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:46 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:47.246875 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-368529826", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "networks": [{"uuid": "716d1add-eeb0-4090-99a3-8e93ac4c3a42"}]}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:47.329279 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.network.neutron [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] validate_networks() for [('716d1add-eeb0-4090-99a3-8e93ac4c3a42', None, None, None, None, None)] {{(pid=127649) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:47:47.372870 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c6982c80-e09f-4f21-bef8-b7a925ba12d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:47.374073 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c6982c80-e09f-4f21-bef8-b7a925ba12d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:47.384014 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c6982c80-e09f-4f21-bef8-b7a925ba12d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:47.384637 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c6982c80-e09f-4f21-bef8-b7a925ba12d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:47.386034 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c6982c80-e09f-4f21-bef8-b7a925ba12d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:47.386881 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c6982c80-e09f-4f21-bef8-b7a925ba12d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:47.477972 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c6982c80-e09f-4f21-bef8-b7a925ba12d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.110641 Nov 02 16:47:47.478682 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 94/193] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:47 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:47.804023 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Flavor limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:47:47.804775 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Image limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:47:47.805553 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Flavor pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:47:47.806179 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Image pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:47:47.806774 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:47:47.818721 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:47.819180 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:47.820009 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:47.820506 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:47.846512 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Getting quotas for project fd124bfe873f4553b53c6d8282df462c. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:47:47.852587 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Getting quotas for user 3f09374d85e441bea89376debca253d9 and project fd124bfe873f4553b53c6d8282df462c. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:47:47.865915 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Going to run 1 instances... {{(pid=127649) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:47:47.870587 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:47:47.919233 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fa7f87ab-580a-4c4a-b650-74e97455e233 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.687194 Nov 02 16:47:47.920581 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 100/194] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:47:47 2021] POST /compute/v2.1/servers => generated 382 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:47:47.934054 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7b4fe5b4-8aa0-4ca4-96f1-3830f3bd02ff tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:47.935550 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7b4fe5b4-8aa0-4ca4-96f1-3830f3bd02ff tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:48.007829 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2c53486c-f9ba-4ee5-ae8c-3bb3748a11f3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:48.008547 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2c53486c-f9ba-4ee5-ae8c-3bb3748a11f3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:48.022231 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2c53486c-f9ba-4ee5-ae8c-3bb3748a11f3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:48.022695 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2c53486c-f9ba-4ee5-ae8c-3bb3748a11f3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:48.023516 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2c53486c-f9ba-4ee5-ae8c-3bb3748a11f3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:48.023964 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2c53486c-f9ba-4ee5-ae8c-3bb3748a11f3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:48.064375 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7b4fe5b4-8aa0-4ca4-96f1-3830f3bd02ff tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:48.094896 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7b4fe5b4-8aa0-4ca4-96f1-3830f3bd02ff tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1221 microversion: 2.1 time: 0.165762 Nov 02 16:47:48.096023 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 95/195] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:47 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1221 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:48.122412 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-eb1a069b-38bf-4a8e-8be6-e9308e5fbd7b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:48.125788 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-eb1a069b-38bf-4a8e-8be6-e9308e5fbd7b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:48.137744 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-eb1a069b-38bf-4a8e-8be6-e9308e5fbd7b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:48.138266 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-eb1a069b-38bf-4a8e-8be6-e9308e5fbd7b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:48.139200 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-eb1a069b-38bf-4a8e-8be6-e9308e5fbd7b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:48.139991 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-eb1a069b-38bf-4a8e-8be6-e9308e5fbd7b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:48.305421 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-eb1a069b-38bf-4a8e-8be6-e9308e5fbd7b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.188552 Nov 02 16:47:48.306710 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 96/196] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:48 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:48.389362 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2c53486c-f9ba-4ee5-ae8c-3bb3748a11f3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:48.400051 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2c53486c-f9ba-4ee5-ae8c-3bb3748a11f3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.398111 Nov 02 16:47:48.400758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 101/197] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:48 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:48.495227 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d415b1e0-57ef-4613-bdcd-c8a229acb856 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:48.497467 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d415b1e0-57ef-4613-bdcd-c8a229acb856 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:48.510143 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d415b1e0-57ef-4613-bdcd-c8a229acb856 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:48.510531 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d415b1e0-57ef-4613-bdcd-c8a229acb856 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:48.512428 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d415b1e0-57ef-4613-bdcd-c8a229acb856 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:48.512428 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d415b1e0-57ef-4613-bdcd-c8a229acb856 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:48.622966 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d415b1e0-57ef-4613-bdcd-c8a229acb856 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.136253 Nov 02 16:47:48.625956 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 97/198] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:48 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:49.126945 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fcdf6744-9578-4e57-ba04-88d12c1b62cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:49.127671 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fcdf6744-9578-4e57-ba04-88d12c1b62cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:49.134937 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fcdf6744-9578-4e57-ba04-88d12c1b62cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:49.135402 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fcdf6744-9578-4e57-ba04-88d12c1b62cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:49.136740 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fcdf6744-9578-4e57-ba04-88d12c1b62cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:49.137188 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fcdf6744-9578-4e57-ba04-88d12c1b62cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:49.214244 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-fcdf6744-9578-4e57-ba04-88d12c1b62cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:49.223966 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fcdf6744-9578-4e57-ba04-88d12c1b62cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1273 microversion: 2.1 time: 0.101017 Nov 02 16:47:49.225008 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 102/199] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:49 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:49.327142 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-670e86ce-d8a9-451f-a0eb-93dbf0a09c83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:49.330362 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-670e86ce-d8a9-451f-a0eb-93dbf0a09c83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:49.345113 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-670e86ce-d8a9-451f-a0eb-93dbf0a09c83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:49.345928 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-670e86ce-d8a9-451f-a0eb-93dbf0a09c83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:49.347046 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-670e86ce-d8a9-451f-a0eb-93dbf0a09c83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:49.348220 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-670e86ce-d8a9-451f-a0eb-93dbf0a09c83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:49.420117 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ad4cb44a-9dc1-4220-b7a0-314da3c26d7a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:49.421328 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ad4cb44a-9dc1-4220-b7a0-314da3c26d7a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:49.430811 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ad4cb44a-9dc1-4220-b7a0-314da3c26d7a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:49.431504 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ad4cb44a-9dc1-4220-b7a0-314da3c26d7a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:49.432699 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ad4cb44a-9dc1-4220-b7a0-314da3c26d7a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:49.433337 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ad4cb44a-9dc1-4220-b7a0-314da3c26d7a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:49.474953 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-670e86ce-d8a9-451f-a0eb-93dbf0a09c83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.159883 Nov 02 16:47:49.479987 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 98/200] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:49 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:49.638360 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-67cf8a3e-2b86-4626-ba4f-dd4968a6b188 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:49.639783 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-67cf8a3e-2b86-4626-ba4f-dd4968a6b188 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:49.669609 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67cf8a3e-2b86-4626-ba4f-dd4968a6b188 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:49.670086 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67cf8a3e-2b86-4626-ba4f-dd4968a6b188 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:49.670938 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67cf8a3e-2b86-4626-ba4f-dd4968a6b188 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:49.671386 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67cf8a3e-2b86-4626-ba4f-dd4968a6b188 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:49.808452 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-67cf8a3e-2b86-4626-ba4f-dd4968a6b188 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.174527 Nov 02 16:47:49.814273 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 99/201] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:49 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:49.860753 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ad4cb44a-9dc1-4220-b7a0-314da3c26d7a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:49.872263 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ad4cb44a-9dc1-4220-b7a0-314da3c26d7a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.457342 Nov 02 16:47:49.873314 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 103/202] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:49 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:50.249686 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a8844e72-5300-423a-ad0a-933b69c4f938 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:50.250429 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a8844e72-5300-423a-ad0a-933b69c4f938 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:50.260008 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a8844e72-5300-423a-ad0a-933b69c4f938 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:50.260910 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a8844e72-5300-423a-ad0a-933b69c4f938 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:50.262373 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a8844e72-5300-423a-ad0a-933b69c4f938 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:50.263129 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a8844e72-5300-423a-ad0a-933b69c4f938 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:50.482383 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a8844e72-5300-423a-ad0a-933b69c4f938 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:50.488163 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bc0c535b-1ae1-403b-95ca-2f80d5f05f41 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:50.490119 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-bc0c535b-1ae1-403b-95ca-2f80d5f05f41 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:50.498934 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a8844e72-5300-423a-ad0a-933b69c4f938 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1321 microversion: 2.1 time: 0.259415 Nov 02 16:47:50.500246 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 100/203] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:50 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:50.501490 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bc0c535b-1ae1-403b-95ca-2f80d5f05f41 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:50.501961 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bc0c535b-1ae1-403b-95ca-2f80d5f05f41 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:50.503034 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bc0c535b-1ae1-403b-95ca-2f80d5f05f41 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:50.503491 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bc0c535b-1ae1-403b-95ca-2f80d5f05f41 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:50.621399 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-bc0c535b-1ae1-403b-95ca-2f80d5f05f41 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.137725 Nov 02 16:47:50.622367 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 104/204] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:50 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:50.824019 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a0ddcfdb-ff1d-49d2-8978-8626a31d27c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:50.826233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a0ddcfdb-ff1d-49d2-8978-8626a31d27c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:50.835764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0ddcfdb-ff1d-49d2-8978-8626a31d27c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:50.836812 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0ddcfdb-ff1d-49d2-8978-8626a31d27c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:50.839194 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0ddcfdb-ff1d-49d2-8978-8626a31d27c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:50.839967 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0ddcfdb-ff1d-49d2-8978-8626a31d27c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:50.895643 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-994b3db9-2035-41ad-baa1-7432059e35ef tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:50.896519 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-994b3db9-2035-41ad-baa1-7432059e35ef tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:50.905522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-994b3db9-2035-41ad-baa1-7432059e35ef tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:50.906005 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-994b3db9-2035-41ad-baa1-7432059e35ef tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:50.906856 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-994b3db9-2035-41ad-baa1-7432059e35ef tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:50.907307 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-994b3db9-2035-41ad-baa1-7432059e35ef tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:50.959508 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a0ddcfdb-ff1d-49d2-8978-8626a31d27c9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.139518 Nov 02 16:47:50.960258 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 101/205] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:50 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:51.255311 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-ae1a92da-c746-408d-a79f-6fbeeaef28d8 req-a78a4695-6622-4fd9-aab1-96316582099a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc421583-8747-41db-b896-e40bed32a554", "tag": "f4eb8e96-4a89-4943-bb1e-67b3c0d0953e"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:51.261581 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:47:51.261581 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:47:51.263172 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-994b3db9-2035-41ad-baa1-7432059e35ef tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:51.280465 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-994b3db9-2035-41ad-baa1-7432059e35ef tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.390798 Nov 02 16:47:51.286435 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-ae1a92da-c746-408d-a79f-6fbeeaef28d8 req-a78a4695-6622-4fd9-aab1-96316582099a service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:51.288029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-ae1a92da-c746-408d-a79f-6fbeeaef28d8 req-a78a4695-6622-4fd9-aab1-96316582099a service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:51.294256 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 105/206] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:50 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:51.307408 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-ae1a92da-c746-408d-a79f-6fbeeaef28d8 req-a78a4695-6622-4fd9-aab1-96316582099a service nova] Creating event network-changed:f4eb8e96-4a89-4943-bb1e-67b3c0d0953e for instance cc421583-8747-41db-b896-e40bed32a554 on hv-cinder-77387 Nov 02 16:47:51.313994 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-ae1a92da-c746-408d-a79f-6fbeeaef28d8 req-a78a4695-6622-4fd9-aab1-96316582099a service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070066 Nov 02 16:47:51.314693 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 102/207] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:47:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:51.522544 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f5cda3dd-5268-4007-8387-904d6d890397 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:51.523462 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f5cda3dd-5268-4007-8387-904d6d890397 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:51.533015 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f5cda3dd-5268-4007-8387-904d6d890397 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:51.534018 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f5cda3dd-5268-4007-8387-904d6d890397 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:51.536200 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f5cda3dd-5268-4007-8387-904d6d890397 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:51.537044 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f5cda3dd-5268-4007-8387-904d6d890397 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:51.636610 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0b171435-ad58-4d5a-8d2b-f5842a7703e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:51.638146 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0b171435-ad58-4d5a-8d2b-f5842a7703e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:51.646955 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0b171435-ad58-4d5a-8d2b-f5842a7703e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:51.647940 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0b171435-ad58-4d5a-8d2b-f5842a7703e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:51.649519 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0b171435-ad58-4d5a-8d2b-f5842a7703e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:51.649981 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0b171435-ad58-4d5a-8d2b-f5842a7703e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:51.770878 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0b171435-ad58-4d5a-8d2b-f5842a7703e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.138134 Nov 02 16:47:51.772951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 103/208] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:51 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 16:47:51.808093 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f5cda3dd-5268-4007-8387-904d6d890397 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:51.821148 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f5cda3dd-5268-4007-8387-904d6d890397 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1321 microversion: 2.1 time: 0.306113 Nov 02 16:47:51.822274 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 106/209] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:51 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:51.972614 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a73f0a08-0383-4a47-93eb-a0d61b6acffd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:51.974494 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a73f0a08-0383-4a47-93eb-a0d61b6acffd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:51.984057 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a73f0a08-0383-4a47-93eb-a0d61b6acffd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:51.984654 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a73f0a08-0383-4a47-93eb-a0d61b6acffd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:51.985810 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a73f0a08-0383-4a47-93eb-a0d61b6acffd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:51.986520 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a73f0a08-0383-4a47-93eb-a0d61b6acffd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:52.137967 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a73f0a08-0383-4a47-93eb-a0d61b6acffd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.170152 Nov 02 16:47:52.138907 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 104/210] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:51 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:52.305028 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-960a3ef3-0440-439b-afad-ec3bab39f402 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:52.305600 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-960a3ef3-0440-439b-afad-ec3bab39f402 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:52.324115 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-960a3ef3-0440-439b-afad-ec3bab39f402 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:52.325433 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-960a3ef3-0440-439b-afad-ec3bab39f402 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:52.327645 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-960a3ef3-0440-439b-afad-ec3bab39f402 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:52.328778 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-960a3ef3-0440-439b-afad-ec3bab39f402 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:52.612833 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-960a3ef3-0440-439b-afad-ec3bab39f402 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:52.625428 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-960a3ef3-0440-439b-afad-ec3bab39f402 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.328886 Nov 02 16:47:52.630129 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 107/211] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:52 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:52.786550 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4a307577-fa55-4985-b04b-1c1ad28f8b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:52.787679 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4a307577-fa55-4985-b04b-1c1ad28f8b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:52.802353 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a307577-fa55-4985-b04b-1c1ad28f8b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:52.802829 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a307577-fa55-4985-b04b-1c1ad28f8b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:52.804009 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a307577-fa55-4985-b04b-1c1ad28f8b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:52.804235 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a307577-fa55-4985-b04b-1c1ad28f8b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:52.843376 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4ae1fd97-a126-4452-ba2c-62a742aecb9d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:52.843759 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4ae1fd97-a126-4452-ba2c-62a742aecb9d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:52.851200 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ae1fd97-a126-4452-ba2c-62a742aecb9d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:52.851660 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ae1fd97-a126-4452-ba2c-62a742aecb9d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:52.852508 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ae1fd97-a126-4452-ba2c-62a742aecb9d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:52.852950 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ae1fd97-a126-4452-ba2c-62a742aecb9d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:52.929387 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4a307577-fa55-4985-b04b-1c1ad28f8b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.148093 Nov 02 16:47:52.930269 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 105/212] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:52 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:53.153120 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0a982626-ba45-465a-9b21-b41a58cc118e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:53.154126 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0a982626-ba45-465a-9b21-b41a58cc118e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:53.162951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0a982626-ba45-465a-9b21-b41a58cc118e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:53.163420 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0a982626-ba45-465a-9b21-b41a58cc118e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:53.164282 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0a982626-ba45-465a-9b21-b41a58cc118e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:53.164737 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0a982626-ba45-465a-9b21-b41a58cc118e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:53.260612 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-4ae1fd97-a126-4452-ba2c-62a742aecb9d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:53.268993 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4ae1fd97-a126-4452-ba2c-62a742aecb9d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1321 microversion: 2.1 time: 0.432411 Nov 02 16:47:53.269697 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 108/213] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:52 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1321 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:53.283995 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0a982626-ba45-465a-9b21-b41a58cc118e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.135926 Nov 02 16:47:53.284778 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 106/214] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:53 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:53.644541 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2fe5ef25-16cb-4b77-a9f1-3054606a7d7d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:53.645743 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2fe5ef25-16cb-4b77-a9f1-3054606a7d7d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:53.651042 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1a1a23e2-7b85-4232-9c1a-df7cd68e6d29 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:53.651750 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1a1a23e2-7b85-4232-9c1a-df7cd68e6d29 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:53.655374 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2fe5ef25-16cb-4b77-a9f1-3054606a7d7d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:53.655970 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2fe5ef25-16cb-4b77-a9f1-3054606a7d7d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:53.656926 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2fe5ef25-16cb-4b77-a9f1-3054606a7d7d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:53.657735 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2fe5ef25-16cb-4b77-a9f1-3054606a7d7d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:53.660953 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1a1a23e2-7b85-4232-9c1a-df7cd68e6d29 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:53.661417 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1a1a23e2-7b85-4232-9c1a-df7cd68e6d29 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:53.662369 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1a1a23e2-7b85-4232-9c1a-df7cd68e6d29 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:53.662988 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1a1a23e2-7b85-4232-9c1a-df7cd68e6d29 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:53.695196 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1a1a23e2-7b85-4232-9c1a-df7cd68e6d29 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Going to try to terminate instance {{(pid=127648) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:47:53.829860 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1a1a23e2-7b85-4232-9c1a-df7cd68e6d29 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "DELETE /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 204 len: 0 microversion: 2.1 time: 0.182770 Nov 02 16:47:53.837607 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 107/215] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:47:53 2021] DELETE /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:47:53.847172 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-17352277-b4c4-49b3-8d77-18a4006bf63e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:53.848540 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-17352277-b4c4-49b3-8d77-18a4006bf63e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:53.855509 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-17352277-b4c4-49b3-8d77-18a4006bf63e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:53.856291 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-17352277-b4c4-49b3-8d77-18a4006bf63e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:53.859254 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-17352277-b4c4-49b3-8d77-18a4006bf63e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:53.860372 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-17352277-b4c4-49b3-8d77-18a4006bf63e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:53.873075 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2fe5ef25-16cb-4b77-a9f1-3054606a7d7d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:53.887370 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2fe5ef25-16cb-4b77-a9f1-3054606a7d7d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.246316 Nov 02 16:47:53.888781 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 109/216] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:53 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:53.943202 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0c895f80-2178-41f7-b364-f62d6423b474 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:53.951512 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0c895f80-2178-41f7-b364-f62d6423b474 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:53.962213 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0c895f80-2178-41f7-b364-f62d6423b474 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:53.963038 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0c895f80-2178-41f7-b364-f62d6423b474 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:53.963630 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0c895f80-2178-41f7-b364-f62d6423b474 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:53.964220 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0c895f80-2178-41f7-b364-f62d6423b474 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:54.031836 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-17352277-b4c4-49b3-8d77-18a4006bf63e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:54.043969 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-17352277-b4c4-49b3-8d77-18a4006bf63e tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1559 microversion: 2.1 time: 0.201712 Nov 02 16:47:54.044668 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 108/217] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:53 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1559 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:54.059964 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0c895f80-2178-41f7-b364-f62d6423b474 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.121915 Nov 02 16:47:54.061235 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 110/218] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:53 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:54.290787 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f388503e-ad22-4d6e-b829-436f70010183 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:54.292142 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f388503e-ad22-4d6e-b829-436f70010183 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:54.299084 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-27054b43-2ea6-48fe-b698-dd52284686df tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:54.300968 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-27054b43-2ea6-48fe-b698-dd52284686df tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:54.304794 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f388503e-ad22-4d6e-b829-436f70010183 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:54.306160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f388503e-ad22-4d6e-b829-436f70010183 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:54.308041 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f388503e-ad22-4d6e-b829-436f70010183 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:54.308769 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f388503e-ad22-4d6e-b829-436f70010183 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:54.310701 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-27054b43-2ea6-48fe-b698-dd52284686df tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:54.311474 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-27054b43-2ea6-48fe-b698-dd52284686df tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:54.312623 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-27054b43-2ea6-48fe-b698-dd52284686df tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:54.313305 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-27054b43-2ea6-48fe-b698-dd52284686df tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:54.427035 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-27054b43-2ea6-48fe-b698-dd52284686df tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.132456 Nov 02 16:47:54.428287 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 111/219] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:54 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:54.531886 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f388503e-ad22-4d6e-b829-436f70010183 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:54.543652 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f388503e-ad22-4d6e-b829-436f70010183 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1321 microversion: 2.1 time: 0.260324 Nov 02 16:47:54.554880 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 109/220] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:54 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:54.908861 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-648b222d-4889-45c7-93bf-56968844d34b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:54.909511 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-648b222d-4889-45c7-93bf-56968844d34b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:54.922819 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-648b222d-4889-45c7-93bf-56968844d34b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:54.923764 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-648b222d-4889-45c7-93bf-56968844d34b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:54.924768 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-648b222d-4889-45c7-93bf-56968844d34b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:54.925514 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-648b222d-4889-45c7-93bf-56968844d34b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:55.070019 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9696b644-5528-410c-97ed-c0248974124b tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:55.072211 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9696b644-5528-410c-97ed-c0248974124b tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:55.080847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9696b644-5528-410c-97ed-c0248974124b tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:55.082543 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9696b644-5528-410c-97ed-c0248974124b tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:55.083850 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9696b644-5528-410c-97ed-c0248974124b tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:55.084606 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9696b644-5528-410c-97ed-c0248974124b tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:55.135627 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-648b222d-4889-45c7-93bf-56968844d34b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:55.150176 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-648b222d-4889-45c7-93bf-56968844d34b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.246204 Nov 02 16:47:55.160130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 112/221] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:54 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:55.160130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1dcff881-5aa2-4997-89c0-99739c787fd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:55.160130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1dcff881-5aa2-4997-89c0-99739c787fd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:55.165460 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1dcff881-5aa2-4997-89c0-99739c787fd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:55.165935 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1dcff881-5aa2-4997-89c0-99739c787fd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:55.166838 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1dcff881-5aa2-4997-89c0-99739c787fd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:55.167613 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1dcff881-5aa2-4997-89c0-99739c787fd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:55.285187 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1dcff881-5aa2-4997-89c0-99739c787fd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.132601 Nov 02 16:47:55.285927 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 113/222] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:55 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:55.290355 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9696b644-5528-410c-97ed-c0248974124b tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:55.303986 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9696b644-5528-410c-97ed-c0248974124b tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1559 microversion: 2.1 time: 0.244627 Nov 02 16:47:55.305166 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 110/223] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:55 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1559 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:55.442318 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-d4f3d337-8c18-4471-a1c4-80701551e027 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:55.443614 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d4f3d337-8c18-4471-a1c4-80701551e027 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:55.452333 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d4f3d337-8c18-4471-a1c4-80701551e027 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:55.452988 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d4f3d337-8c18-4471-a1c4-80701551e027 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:55.454162 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d4f3d337-8c18-4471-a1c4-80701551e027 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:55.454962 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d4f3d337-8c18-4471-a1c4-80701551e027 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:55.550991 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-d4f3d337-8c18-4471-a1c4-80701551e027 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.113773 Nov 02 16:47:55.552089 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 114/224] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:55 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:55.563372 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cc92adaf-4687-4928-ba9f-b0cdd0a4f80e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:55.564126 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-cc92adaf-4687-4928-ba9f-b0cdd0a4f80e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:55.572068 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc92adaf-4687-4928-ba9f-b0cdd0a4f80e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:55.572708 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc92adaf-4687-4928-ba9f-b0cdd0a4f80e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:55.573625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc92adaf-4687-4928-ba9f-b0cdd0a4f80e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:55.574078 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc92adaf-4687-4928-ba9f-b0cdd0a4f80e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:55.731569 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-cc92adaf-4687-4928-ba9f-b0cdd0a4f80e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:55.743168 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-cc92adaf-4687-4928-ba9f-b0cdd0a4f80e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1321 microversion: 2.1 time: 0.184345 Nov 02 16:47:55.744067 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 111/225] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:55 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:56.177777 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e61ac33f-454a-4d32-96a9-100ae6ad4dca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:56.179056 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e61ac33f-454a-4d32-96a9-100ae6ad4dca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:56.193352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e61ac33f-454a-4d32-96a9-100ae6ad4dca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:56.194366 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e61ac33f-454a-4d32-96a9-100ae6ad4dca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:56.195824 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e61ac33f-454a-4d32-96a9-100ae6ad4dca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:56.196656 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e61ac33f-454a-4d32-96a9-100ae6ad4dca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:56.303060 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ab8b2a19-5846-4c1b-95d1-bdc112c7e6a8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:56.304871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ab8b2a19-5846-4c1b-95d1-bdc112c7e6a8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:56.320674 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ab8b2a19-5846-4c1b-95d1-bdc112c7e6a8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:56.321823 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ab8b2a19-5846-4c1b-95d1-bdc112c7e6a8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:56.322935 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ab8b2a19-5846-4c1b-95d1-bdc112c7e6a8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:56.323807 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ab8b2a19-5846-4c1b-95d1-bdc112c7e6a8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:56.442840 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ab8b2a19-5846-4c1b-95d1-bdc112c7e6a8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.147426 Nov 02 16:47:56.443170 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e61ac33f-454a-4d32-96a9-100ae6ad4dca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:56.447025 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 112/226] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:56 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:56.453805 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e61ac33f-454a-4d32-96a9-100ae6ad4dca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.287582 Nov 02 16:47:56.454174 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-67964e1c-58b4-439e-8bb6-15bddb48c04a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:56.456230 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-67964e1c-58b4-439e-8bb6-15bddb48c04a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:56.456567 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 115/227] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:56 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:56.475907 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67964e1c-58b4-439e-8bb6-15bddb48c04a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:56.476532 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67964e1c-58b4-439e-8bb6-15bddb48c04a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:56.477382 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67964e1c-58b4-439e-8bb6-15bddb48c04a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:56.477829 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67964e1c-58b4-439e-8bb6-15bddb48c04a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:56.566278 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8415dc16-a677-48b4-a90e-29cfd53a60ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:56.567987 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8415dc16-a677-48b4-a90e-29cfd53a60ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:56.588284 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8415dc16-a677-48b4-a90e-29cfd53a60ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:56.588949 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8415dc16-a677-48b4-a90e-29cfd53a60ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:56.595449 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8415dc16-a677-48b4-a90e-29cfd53a60ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:56.595929 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8415dc16-a677-48b4-a90e-29cfd53a60ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:56.688993 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-67964e1c-58b4-439e-8bb6-15bddb48c04a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:56.700096 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-67964e1c-58b4-439e-8bb6-15bddb48c04a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1559 microversion: 2.1 time: 0.251192 Nov 02 16:47:56.700865 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 113/228] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:56 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1559 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:56.716251 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8415dc16-a677-48b4-a90e-29cfd53a60ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.156400 Nov 02 16:47:56.717028 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 116/229] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:56 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:56.764093 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-27cc2d41-da62-4993-9b30-748f8776b98c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:56.764972 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-27cc2d41-da62-4993-9b30-748f8776b98c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:56.774314 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-27cc2d41-da62-4993-9b30-748f8776b98c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:56.774640 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-27cc2d41-da62-4993-9b30-748f8776b98c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:56.775644 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-27cc2d41-da62-4993-9b30-748f8776b98c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:56.776162 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-27cc2d41-da62-4993-9b30-748f8776b98c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:56.991487 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-27cc2d41-da62-4993-9b30-748f8776b98c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:57.006172 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-27cc2d41-da62-4993-9b30-748f8776b98c tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1321 microversion: 2.1 time: 0.246306 Nov 02 16:47:57.007268 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 114/230] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:56 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:57.461611 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-99878a52-f4ea-4b4b-b08d-d786a6d31a05 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:57.464405 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-99878a52-f4ea-4b4b-b08d-d786a6d31a05 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:57.474304 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-99878a52-f4ea-4b4b-b08d-d786a6d31a05 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:57.474733 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-30cffbc1-7a35-421c-a8ff-8123780c1135 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:57.475505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-30cffbc1-7a35-421c-a8ff-8123780c1135 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:57.476237 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-99878a52-f4ea-4b4b-b08d-d786a6d31a05 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:57.477387 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-99878a52-f4ea-4b4b-b08d-d786a6d31a05 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:57.478084 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-99878a52-f4ea-4b4b-b08d-d786a6d31a05 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:57.494815 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30cffbc1-7a35-421c-a8ff-8123780c1135 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:57.496292 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30cffbc1-7a35-421c-a8ff-8123780c1135 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:57.497454 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30cffbc1-7a35-421c-a8ff-8123780c1135 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:57.499356 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30cffbc1-7a35-421c-a8ff-8123780c1135 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:57.586947 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-99878a52-f4ea-4b4b-b08d-d786a6d31a05 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 14 microversion: 2.1 time: 0.135134 Nov 02 16:47:57.589305 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 117/231] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:57 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:47:57.720339 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2ec5080d-6a99-4bf4-8d16-e536c668e5b6 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:57.721573 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2ec5080d-6a99-4bf4-8d16-e536c668e5b6 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:57.731500 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2ec5080d-6a99-4bf4-8d16-e536c668e5b6 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:57.732516 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2ec5080d-6a99-4bf4-8d16-e536c668e5b6 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:57.733719 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2ec5080d-6a99-4bf4-8d16-e536c668e5b6 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:57.734074 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-30cffbc1-7a35-421c-a8ff-8123780c1135 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:57.734723 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2ec5080d-6a99-4bf4-8d16-e536c668e5b6 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:57.749962 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-30cffbc1-7a35-421c-a8ff-8123780c1135 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.281003 Nov 02 16:47:57.752510 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 115/232] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:57 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:57.766088 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3c8707a8-fbad-49d1-a1b5-aa43607d7cec tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:57.768276 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3c8707a8-fbad-49d1-a1b5-aa43607d7cec tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:57.788782 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3c8707a8-fbad-49d1-a1b5-aa43607d7cec tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:57.789366 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3c8707a8-fbad-49d1-a1b5-aa43607d7cec tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:57.790278 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3c8707a8-fbad-49d1-a1b5-aa43607d7cec tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:57.793419 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3c8707a8-fbad-49d1-a1b5-aa43607d7cec tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:57.890280 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3c8707a8-fbad-49d1-a1b5-aa43607d7cec tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.136266 Nov 02 16:47:57.891229 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 116/233] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:57 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:58.025001 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9decfdeb-32c7-4be9-abf1-5e989efba382 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:58.025881 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9decfdeb-32c7-4be9-abf1-5e989efba382 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:58.034475 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9decfdeb-32c7-4be9-abf1-5e989efba382 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:58.034901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9decfdeb-32c7-4be9-abf1-5e989efba382 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:58.035962 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9decfdeb-32c7-4be9-abf1-5e989efba382 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:58.036742 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9decfdeb-32c7-4be9-abf1-5e989efba382 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:58.117248 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2ec5080d-6a99-4bf4-8d16-e536c668e5b6 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:58.136580 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2ec5080d-6a99-4bf4-8d16-e536c668e5b6 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1559 microversion: 2.1 time: 0.420672 Nov 02 16:47:58.137942 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 118/234] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:57 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1559 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:58.240333 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9decfdeb-32c7-4be9-abf1-5e989efba382 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:58.253499 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9decfdeb-32c7-4be9-abf1-5e989efba382 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1321 microversion: 2.1 time: 0.233266 Nov 02 16:47:58.255586 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 117/235] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:58 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:58.332013 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-7f6df66e-6de1-45ce-bedf-469cb4e793c7 req-178f2aa2-9614-41fe-bb09-7dc2c2e4568b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72140edf-a256-42c5-96ab-aa20fadf6e0b", "name": "network-vif-deleted", "tag": "9877734a-b105-41fe-bb14-bcc253387958"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:58.334566 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:47:58.334566 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:47:58.346039 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-7f6df66e-6de1-45ce-bedf-469cb4e793c7 req-178f2aa2-9614-41fe-bb09-7dc2c2e4568b service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:58.346701 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-7f6df66e-6de1-45ce-bedf-469cb4e793c7 req-178f2aa2-9614-41fe-bb09-7dc2c2e4568b service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:58.362393 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-7f6df66e-6de1-45ce-bedf-469cb4e793c7 req-178f2aa2-9614-41fe-bb09-7dc2c2e4568b service nova] Creating event network-vif-deleted:9877734a-b105-41fe-bb14-bcc253387958 for instance 72140edf-a256-42c5-96ab-aa20fadf6e0b on hv-cinder-77387 Nov 02 16:47:58.372006 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-7f6df66e-6de1-45ce-bedf-469cb4e793c7 req-178f2aa2-9614-41fe-bb09-7dc2c2e4568b service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044971 Nov 02 16:47:58.373532 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 119/236] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:47:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:47:58.599673 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4120a363-02b7-46e8-99cd-6e71baff9fe7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:58.600706 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4120a363-02b7-46e8-99cd-6e71baff9fe7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:58.607939 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4120a363-02b7-46e8-99cd-6e71baff9fe7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:58.608504 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4120a363-02b7-46e8-99cd-6e71baff9fe7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:58.609317 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4120a363-02b7-46e8-99cd-6e71baff9fe7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:58.609769 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4120a363-02b7-46e8-99cd-6e71baff9fe7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:58.722097 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4120a363-02b7-46e8-99cd-6e71baff9fe7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 3504 microversion: 2.1 time: 0.127001 Nov 02 16:47:58.723697 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 118/237] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:58 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 3504 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:58.780680 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7dde8192-629a-47e7-9b21-6a1c8316d092 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:58.782080 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7dde8192-629a-47e7-9b21-6a1c8316d092 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:58.789672 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7dde8192-629a-47e7-9b21-6a1c8316d092 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:58.790131 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7dde8192-629a-47e7-9b21-6a1c8316d092 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:58.790966 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7dde8192-629a-47e7-9b21-6a1c8316d092 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:58.791402 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7dde8192-629a-47e7-9b21-6a1c8316d092 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:58.904250 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-893149f5-5e37-4d54-bd55-1da0d9693493 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:58.905345 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-893149f5-5e37-4d54-bd55-1da0d9693493 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:58.916394 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-893149f5-5e37-4d54-bd55-1da0d9693493 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:58.916916 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-893149f5-5e37-4d54-bd55-1da0d9693493 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:58.921754 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-893149f5-5e37-4d54-bd55-1da0d9693493 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:58.922686 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-893149f5-5e37-4d54-bd55-1da0d9693493 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:58.978267 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7dde8192-629a-47e7-9b21-6a1c8316d092 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:58.987504 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7dde8192-629a-47e7-9b21-6a1c8316d092 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.211670 Nov 02 16:47:58.989048 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 120/238] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:58 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:59.038760 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-893149f5-5e37-4d54-bd55-1da0d9693493 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.138708 Nov 02 16:47:59.043305 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 119/239] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:47:58 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:47:59.155409 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e4468f63-2a53-4e6e-87b8-a61446e1406c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:59.156046 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e4468f63-2a53-4e6e-87b8-a61446e1406c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:59.166002 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4468f63-2a53-4e6e-87b8-a61446e1406c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:59.166470 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4468f63-2a53-4e6e-87b8-a61446e1406c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:59.167345 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4468f63-2a53-4e6e-87b8-a61446e1406c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:59.168004 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4468f63-2a53-4e6e-87b8-a61446e1406c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:59.215387 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4468f63-2a53-4e6e-87b8-a61446e1406c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:59.215547 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4468f63-2a53-4e6e-87b8-a61446e1406c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:59.216041 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-e4468f63-2a53-4e6e-87b8-a61446e1406c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lazy-loading 'fault' on Instance uuid 72140edf-a256-42c5-96ab-aa20fadf6e0b {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:47:59.263690 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-fd2f9782-13ff-4d94-830c-f815f242f25d req-7e0f6149-8c66-4246-bb69-df00e31975aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc421583-8747-41db-b896-e40bed32a554", "name": "network-vif-plugged", "status": "completed", "tag": "f4eb8e96-4a89-4943-bb1e-67b3c0d0953e"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:59.266314 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:47:59.266314 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:47:59.271088 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e4468f63-2a53-4e6e-87b8-a61446e1406c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '436329e99f8e421ab41666884f7888d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3895ec42d70403e8667ea0b09eb9ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:59.278998 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-fd2f9782-13ff-4d94-830c-f815f242f25d req-7e0f6149-8c66-4246-bb69-df00e31975aa service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:59.279165 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-fd2f9782-13ff-4d94-830c-f815f242f25d req-7e0f6149-8c66-4246-bb69-df00e31975aa service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:59.288390 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e4468f63-2a53-4e6e-87b8-a61446e1406c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 200 len: 1355 microversion: 2.1 time: 0.136955 Nov 02 16:47:59.289637 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 121/240] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:59 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 1355 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:59.295407 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6dc12201-1bfa-4e79-a01b-67549d7bb440 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:47:59.296313 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6dc12201-1bfa-4e79-a01b-67549d7bb440 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:59.304692 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6dc12201-1bfa-4e79-a01b-67549d7bb440 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:59.305279 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6dc12201-1bfa-4e79-a01b-67549d7bb440 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:59.306234 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6dc12201-1bfa-4e79-a01b-67549d7bb440 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:59.306952 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6dc12201-1bfa-4e79-a01b-67549d7bb440 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:59.517924 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6dc12201-1bfa-4e79-a01b-67549d7bb440 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:47:59.538545 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6dc12201-1bfa-4e79-a01b-67549d7bb440 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1321 microversion: 2.1 time: 0.247467 Nov 02 16:47:59.539221 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 122/241] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:47:59 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:47:59.565802 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-fd2f9782-13ff-4d94-830c-f815f242f25d req-7e0f6149-8c66-4246-bb69-df00e31975aa service nova] Creating event network-vif-plugged:f4eb8e96-4a89-4943-bb1e-67b3c0d0953e for instance cc421583-8747-41db-b896-e40bed32a554 on hv-cinder-77387 Nov 02 16:47:59.573891 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-fd2f9782-13ff-4d94-830c-f815f242f25d req-7e0f6149-8c66-4246-bb69-df00e31975aa service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.315038 Nov 02 16:47:59.574835 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 120/242] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:47:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:47:59.736688 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b35ce450-342b-4ebb-b68e-b8493c3da534 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:47:59.737640 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b35ce450-342b-4ebb-b68e-b8493c3da534 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:47:59.745190 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b35ce450-342b-4ebb-b68e-b8493c3da534 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:59.746437 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b35ce450-342b-4ebb-b68e-b8493c3da534 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:59.747452 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b35ce450-342b-4ebb-b68e-b8493c3da534 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:47:59.748126 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b35ce450-342b-4ebb-b68e-b8493c3da534 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:47:59.919920 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b35ce450-342b-4ebb-b68e-b8493c3da534 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 7120 microversion: 2.1 time: 0.187358 Nov 02 16:47:59.922293 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 123/243] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:47:59 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 7120 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:00.012136 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c4f5658c-b00f-41a2-9617-261eba630232 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:00.013556 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c4f5658c-b00f-41a2-9617-261eba630232 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:00.022496 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c4f5658c-b00f-41a2-9617-261eba630232 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:00.023126 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c4f5658c-b00f-41a2-9617-261eba630232 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:00.023961 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c4f5658c-b00f-41a2-9617-261eba630232 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:00.024444 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c4f5658c-b00f-41a2-9617-261eba630232 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:00.052949 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-74b5f56d-1bba-4d0e-9d59-9b50a4b4e07f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:00.054467 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-74b5f56d-1bba-4d0e-9d59-9b50a4b4e07f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:00.066494 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-74b5f56d-1bba-4d0e-9d59-9b50a4b4e07f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:00.067554 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-74b5f56d-1bba-4d0e-9d59-9b50a4b4e07f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:00.068737 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-74b5f56d-1bba-4d0e-9d59-9b50a4b4e07f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:00.069538 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-74b5f56d-1bba-4d0e-9d59-9b50a4b4e07f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:00.222887 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-c4f5658c-b00f-41a2-9617-261eba630232 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:00.233695 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c4f5658c-b00f-41a2-9617-261eba630232 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.230983 Nov 02 16:48:00.244803 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 121/244] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:00 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:00.304051 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-74b5f56d-1bba-4d0e-9d59-9b50a4b4e07f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.256500 Nov 02 16:48:00.307286 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 124/245] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:00 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:00.308755 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-400801c0-63a9-437f-8057-009fdb21069a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:00.309826 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-400801c0-63a9-437f-8057-009fdb21069a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:00.320128 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-400801c0-63a9-437f-8057-009fdb21069a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:00.320128 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-400801c0-63a9-437f-8057-009fdb21069a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:00.320657 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-400801c0-63a9-437f-8057-009fdb21069a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:00.321115 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-400801c0-63a9-437f-8057-009fdb21069a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:00.342486 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-400801c0-63a9-437f-8057-009fdb21069a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] HTTP exception thrown: Instance 72140edf-a256-42c5-96ab-aa20fadf6e0b could not be found. Nov 02 16:48:00.344704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-400801c0-63a9-437f-8057-009fdb21069a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Returning 404 to user: Instance 72140edf-a256-42c5-96ab-aa20fadf6e0b could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:48:00.344704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-400801c0-63a9-437f-8057-009fdb21069a tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 404 len: 111 microversion: 2.1 time: 0.040293 Nov 02 16:48:00.344704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 122/246] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:00 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:48:00.466107 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-326dae33-4f9b-4072-9915-d3787f87026c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:00.467269 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-326dae33-4f9b-4072-9915-d3787f87026c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:00.475374 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-326dae33-4f9b-4072-9915-d3787f87026c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:00.475849 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-326dae33-4f9b-4072-9915-d3787f87026c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:00.476709 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-326dae33-4f9b-4072-9915-d3787f87026c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:00.477162 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-326dae33-4f9b-4072-9915-d3787f87026c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:00.493805 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-326dae33-4f9b-4072-9915-d3787f87026c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] HTTP exception thrown: Instance 72140edf-a256-42c5-96ab-aa20fadf6e0b could not be found. Nov 02 16:48:00.494333 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-326dae33-4f9b-4072-9915-d3787f87026c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Returning 404 to user: Instance 72140edf-a256-42c5-96ab-aa20fadf6e0b could not be found. {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:48:00.495245 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-326dae33-4f9b-4072-9915-d3787f87026c tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033879 Nov 02 16:48:00.495891 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 125/247] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:48:00 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:48:00.558128 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d02f1db7-935c-4e8c-811b-32d07feeb27b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:00.559356 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d02f1db7-935c-4e8c-811b-32d07feeb27b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:00.568154 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d02f1db7-935c-4e8c-811b-32d07feeb27b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:00.568681 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d02f1db7-935c-4e8c-811b-32d07feeb27b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:00.569539 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d02f1db7-935c-4e8c-811b-32d07feeb27b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:00.569999 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d02f1db7-935c-4e8c-811b-32d07feeb27b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:00.773138 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d02f1db7-935c-4e8c-811b-32d07feeb27b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:00.784471 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d02f1db7-935c-4e8c-811b-32d07feeb27b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1321 microversion: 2.1 time: 0.228966 Nov 02 16:48:00.784471 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 123/248] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:00 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:00.931241 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6298f24f-6b79-410f-b46e-353592680761 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:00.932295 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6298f24f-6b79-410f-b46e-353592680761 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:00.940003 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6298f24f-6b79-410f-b46e-353592680761 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:00.940510 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6298f24f-6b79-410f-b46e-353592680761 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:00.941382 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6298f24f-6b79-410f-b46e-353592680761 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:00.941831 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6298f24f-6b79-410f-b46e-353592680761 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:01.045011 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6298f24f-6b79-410f-b46e-353592680761 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 9710 microversion: 2.1 time: 0.117563 Nov 02 16:48:01.045624 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 126/249] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:00 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 9710 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:01.253320 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c6d4f2cd-8479-49eb-9a2a-e7caa53436cb tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:01.254136 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c6d4f2cd-8479-49eb-9a2a-e7caa53436cb tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:01.263719 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c6d4f2cd-8479-49eb-9a2a-e7caa53436cb tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:01.264685 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c6d4f2cd-8479-49eb-9a2a-e7caa53436cb tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:01.265060 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c6d4f2cd-8479-49eb-9a2a-e7caa53436cb tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:01.265510 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c6d4f2cd-8479-49eb-9a2a-e7caa53436cb tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:01.320450 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-60b2f71d-d583-45b5-bbe8-e1a31f5c707f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:01.321939 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-60b2f71d-d583-45b5-bbe8-e1a31f5c707f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:01.336355 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-60b2f71d-d583-45b5-bbe8-e1a31f5c707f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:01.336863 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-60b2f71d-d583-45b5-bbe8-e1a31f5c707f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:01.337985 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-60b2f71d-d583-45b5-bbe8-e1a31f5c707f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:01.338436 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-60b2f71d-d583-45b5-bbe8-e1a31f5c707f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:01.425836 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-60b2f71d-d583-45b5-bbe8-e1a31f5c707f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 14 microversion: 2.20 time: 0.110496 Nov 02 16:48:01.426783 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 127/250] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:01 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:01.438045 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-c6d4f2cd-8479-49eb-9a2a-e7caa53436cb tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:01.447691 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c6d4f2cd-8479-49eb-9a2a-e7caa53436cb tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.199113 Nov 02 16:48:01.448395 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 124/251] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:01 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:01.737492 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ed42845c-f2dd-422e-a9d7-c2df4cb98e76 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:01.739092 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ed42845c-f2dd-422e-a9d7-c2df4cb98e76 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:01.747691 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ed42845c-f2dd-422e-a9d7-c2df4cb98e76 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:01.748915 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ed42845c-f2dd-422e-a9d7-c2df4cb98e76 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:01.750409 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ed42845c-f2dd-422e-a9d7-c2df4cb98e76 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:01.751181 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ed42845c-f2dd-422e-a9d7-c2df4cb98e76 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:01.783927 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-ed42845c-f2dd-422e-a9d7-c2df4cb98e76 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] HTTP exception thrown: Instance 72140edf-a256-42c5-96ab-aa20fadf6e0b could not be found. Nov 02 16:48:01.784680 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ed42845c-f2dd-422e-a9d7-c2df4cb98e76 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Returning 404 to user: Instance 72140edf-a256-42c5-96ab-aa20fadf6e0b could not be found. {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:48:01.786357 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ed42845c-f2dd-422e-a9d7-c2df4cb98e76 tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "DELETE /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 404 len: 111 microversion: 2.1 time: 0.054606 Nov 02 16:48:01.787232 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 128/252] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:48:01 2021] DELETE /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:48:01.801635 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-66caf6fb-38b4-49e3-ac61-6a10cfa8704d tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:01.806745 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-66caf6fb-38b4-49e3-ac61-6a10cfa8704d tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] [instance: 72140edf-a256-42c5-96ab-aa20fadf6e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:01.807215 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1263df03-9e67-4cce-8b10-bb99d8eae37b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:01.810676 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1263df03-9e67-4cce-8b10-bb99d8eae37b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:01.827783 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1263df03-9e67-4cce-8b10-bb99d8eae37b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:01.828279 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1263df03-9e67-4cce-8b10-bb99d8eae37b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:01.828976 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-66caf6fb-38b4-49e3-ac61-6a10cfa8704d tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:01.829121 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1263df03-9e67-4cce-8b10-bb99d8eae37b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:01.829544 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-66caf6fb-38b4-49e3-ac61-6a10cfa8704d tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:01.829713 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1263df03-9e67-4cce-8b10-bb99d8eae37b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:01.830823 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-66caf6fb-38b4-49e3-ac61-6a10cfa8704d tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:01.831368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-66caf6fb-38b4-49e3-ac61-6a10cfa8704d tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:01.861737 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-66caf6fb-38b4-49e3-ac61-6a10cfa8704d tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] HTTP exception thrown: Instance 72140edf-a256-42c5-96ab-aa20fadf6e0b could not be found. Nov 02 16:48:01.880489 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-66caf6fb-38b4-49e3-ac61-6a10cfa8704d tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] Returning 404 to user: Instance 72140edf-a256-42c5-96ab-aa20fadf6e0b could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:48:01.880489 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-66caf6fb-38b4-49e3-ac61-6a10cfa8704d tempest-DeleteServersTestJSON-891599112 tempest-DeleteServersTestJSON-891599112-project] 10.222.0.118 "GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b" status: 404 len: 111 microversion: 2.1 time: 0.080703 Nov 02 16:48:01.880489 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 125/253] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:01 2021] GET /compute/v2.1/servers/72140edf-a256-42c5-96ab-aa20fadf6e0b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:48:02.064145 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ab8a76bc-802a-4076-868d-55e1d2ca5005 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:02.065677 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ab8a76bc-802a-4076-868d-55e1d2ca5005 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:02.077325 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ab8a76bc-802a-4076-868d-55e1d2ca5005 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:02.077787 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ab8a76bc-802a-4076-868d-55e1d2ca5005 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:02.079231 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ab8a76bc-802a-4076-868d-55e1d2ca5005 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:02.079995 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ab8a76bc-802a-4076-868d-55e1d2ca5005 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:02.151095 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1263df03-9e67-4cce-8b10-bb99d8eae37b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:02.161234 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1263df03-9e67-4cce-8b10-bb99d8eae37b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1511 microversion: 2.1 time: 0.358113 Nov 02 16:48:02.173596 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 129/254] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:01 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:02.180026 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1469522836", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:02.194186 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ab8a76bc-802a-4076-868d-55e1d2ca5005 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 12531 microversion: 2.1 time: 0.138343 Nov 02 16:48:02.196096 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 126/255] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:02 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 12531 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:02.204287 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-50783762-ed9d-4277-ab05-ed2423c4ee1e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6e884ae-d8d1-4fc4-8343-52da07aabd21"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:02.206294 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-50783762-ed9d-4277-ab05-ed2423c4ee1e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:02.228259 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-50783762-ed9d-4277-ab05-ed2423c4ee1e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:02.229260 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-50783762-ed9d-4277-ab05-ed2423c4ee1e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:02.230209 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-50783762-ed9d-4277-ab05-ed2423c4ee1e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:02.230679 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-50783762-ed9d-4277-ab05-ed2423c4ee1e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:02.288455 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.network.neutron [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] validate_networks() for None {{(pid=127649) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:48:02.363540 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-50783762-ed9d-4277-ab05-ed2423c4ee1e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] HTTP exception thrown: Invalid volume: volume a6e884ae-d8d1-4fc4-8343-52da07aabd21 is already attached to instances: e699b34f-97c8-4316-9e80-4820d1f94e26 Nov 02 16:48:02.364562 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-50783762-ed9d-4277-ab05-ed2423c4ee1e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Returning 400 to user: Invalid volume: volume a6e884ae-d8d1-4fc4-8343-52da07aabd21 is already attached to instances: e699b34f-97c8-4316-9e80-4820d1f94e26 {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:48:02.365584 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-50783762-ed9d-4277-ab05-ed2423c4ee1e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "POST /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.167796 Nov 02 16:48:02.366531 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 127/256] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:48:02 2021] POST /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554/os-volume_attachments => generated 174 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 16:48:02.444034 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e6df531d-5629-47b0-9d22-46db99f058a8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:02.445564 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e6df531d-5629-47b0-9d22-46db99f058a8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:02.457880 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e6df531d-5629-47b0-9d22-46db99f058a8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:02.458445 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e6df531d-5629-47b0-9d22-46db99f058a8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:02.459530 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e6df531d-5629-47b0-9d22-46db99f058a8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:02.460554 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e6df531d-5629-47b0-9d22-46db99f058a8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:02.586522 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e6df531d-5629-47b0-9d22-46db99f058a8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 5186 microversion: 2.20 time: 0.147212 Nov 02 16:48:02.587308 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 128/257] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:02 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 5186 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:48:02.595423 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-efe28fb2-b5ee-485f-a230-4d4e33ad1413 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:02.596057 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-efe28fb2-b5ee-485f-a230-4d4e33ad1413 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:02.608362 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-efe28fb2-b5ee-485f-a230-4d4e33ad1413 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:02.608648 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-efe28fb2-b5ee-485f-a230-4d4e33ad1413 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:02.609476 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-efe28fb2-b5ee-485f-a230-4d4e33ad1413 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:02.609986 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-efe28fb2-b5ee-485f-a230-4d4e33ad1413 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:02.771911 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.objects.instance [None req-efe28fb2-b5ee-485f-a230-4d4e33ad1413 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lazy-loading 'services' on Instance uuid e699b34f-97c8-4316-9e80-4820d1f94e26 {{(pid=127648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:48:02.913687 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-efe28fb2-b5ee-485f-a230-4d4e33ad1413 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "DELETE /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26/os-volume_attachments/a6e884ae-d8d1-4fc4-8343-52da07aabd21" status: 202 len: 0 microversion: 2.1 time: 0.324282 Nov 02 16:48:02.914387 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 129/258] 10.222.0.118 () {58 vars in 1420 bytes} [Tue Nov 2 16:48:02 2021] DELETE /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26/os-volume_attachments/a6e884ae-d8d1-4fc4-8343-52da07aabd21 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:02.920417 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1ea4a04d-fa3e-4653-9809-6fb5ae632fe2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:02.921155 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1ea4a04d-fa3e-4653-9809-6fb5ae632fe2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:02.931933 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1ea4a04d-fa3e-4653-9809-6fb5ae632fe2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:02.932976 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1ea4a04d-fa3e-4653-9809-6fb5ae632fe2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:02.934746 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1ea4a04d-fa3e-4653-9809-6fb5ae632fe2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:02.935829 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1ea4a04d-fa3e-4653-9809-6fb5ae632fe2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:03.069588 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Flavor limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:48:03.080758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Image limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:48:03.080758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Flavor pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:48:03.080758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Image pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:48:03.080758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:48:03.100143 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:03.101050 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:03.103448 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:03.104289 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:03.138899 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Getting quotas for project 8ab3a00c690849c1bd017a9733cec34a. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:48:03.147745 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Getting quotas for user a96a35c3d9db45909cc5b37d26e07e8b and project 8ab3a00c690849c1bd017a9733cec34a. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:48:03.172715 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Going to run 1 instances... {{(pid=127649) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:48:03.181294 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:48:03.254305 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-035d77ca-83d7-48a0-9db6-d8a145636777 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.078986 Nov 02 16:48:03.255332 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 130/259] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:48:02 2021] POST /compute/v2.1/servers => generated 382 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:48:03.264517 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-be7bca19-17d7-4930-bd4f-6d91adf7c978 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:03.265877 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-be7bca19-17d7-4930-bd4f-6d91adf7c978 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:03.274989 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-be7bca19-17d7-4930-bd4f-6d91adf7c978 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:03.276071 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-be7bca19-17d7-4930-bd4f-6d91adf7c978 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:03.276931 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-be7bca19-17d7-4930-bd4f-6d91adf7c978 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:03.277603 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-be7bca19-17d7-4930-bd4f-6d91adf7c978 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:03.278449 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1ea4a04d-fa3e-4653-9809-6fb5ae632fe2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:03.287952 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1ea4a04d-fa3e-4653-9809-6fb5ae632fe2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.371940 Nov 02 16:48:03.288910 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 130/260] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:02 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:03.294433 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f19a3f31-c3dd-4466-8dea-fb8636a4b71b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:03.296827 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f19a3f31-c3dd-4466-8dea-fb8636a4b71b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:03.334796 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-be7bca19-17d7-4930-bd4f-6d91adf7c978 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077846 Nov 02 16:48:03.335070 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f19a3f31-c3dd-4466-8dea-fb8636a4b71b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:03.335436 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f19a3f31-c3dd-4466-8dea-fb8636a4b71b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:03.336141 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 131/261] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:48:03 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:03.337276 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f19a3f31-c3dd-4466-8dea-fb8636a4b71b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:03.337770 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f19a3f31-c3dd-4466-8dea-fb8636a4b71b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:03.351300 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-47a49f57-7927-4b18-b024-635fb686819c tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:03.352462 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-47a49f57-7927-4b18-b024-635fb686819c tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:03.441770 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-47a49f57-7927-4b18-b024-635fb686819c tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:03.451107 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-47a49f57-7927-4b18-b024-635fb686819c tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1219 microversion: 2.1 time: 0.113561 Nov 02 16:48:03.452214 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 132/262] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:03 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:03.495099 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f19a3f31-c3dd-4466-8dea-fb8636a4b71b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 15577 microversion: 2.1 time: 0.204356 Nov 02 16:48:03.495842 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 131/263] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:03 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 15577 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:03.606328 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4d304fb1-9054-41a0-bc95-a9f46bb21f86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:03.607739 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4d304fb1-9054-41a0-bc95-a9f46bb21f86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:03.618316 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4d304fb1-9054-41a0-bc95-a9f46bb21f86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:03.619161 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4d304fb1-9054-41a0-bc95-a9f46bb21f86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:03.620365 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4d304fb1-9054-41a0-bc95-a9f46bb21f86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:03.620884 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4d304fb1-9054-41a0-bc95-a9f46bb21f86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:03.784562 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4d304fb1-9054-41a0-bc95-a9f46bb21f86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 9366 microversion: 2.20 time: 0.184882 Nov 02 16:48:03.793408 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 133/264] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:03 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 9366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:48:04.310207 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-8c03d15a-6574-47a1-b7ac-166749c4809a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:04.312026 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8c03d15a-6574-47a1-b7ac-166749c4809a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:04.334601 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8c03d15a-6574-47a1-b7ac-166749c4809a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:04.337792 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8c03d15a-6574-47a1-b7ac-166749c4809a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:04.338867 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8c03d15a-6574-47a1-b7ac-166749c4809a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:04.340355 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8c03d15a-6574-47a1-b7ac-166749c4809a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:04.349798 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-04415c8e-7fd5-4734-b50f-40255fbb9a68 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:04.351098 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-04415c8e-7fd5-4734-b50f-40255fbb9a68 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:04.381217 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-04415c8e-7fd5-4734-b50f-40255fbb9a68 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:04.381613 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-04415c8e-7fd5-4734-b50f-40255fbb9a68 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:04.382461 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-04415c8e-7fd5-4734-b50f-40255fbb9a68 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:04.382896 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-04415c8e-7fd5-4734-b50f-40255fbb9a68 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:04.438075 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-04415c8e-7fd5-4734-b50f-40255fbb9a68 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093586 Nov 02 16:48:04.449864 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 134/265] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:48:04 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:48:04.475910 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-64f70206-8cca-41cd-8897-8516959bc223 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:04.476753 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-64f70206-8cca-41cd-8897-8516959bc223 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:04.499194 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-64f70206-8cca-41cd-8897-8516959bc223 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:04.504303 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-64f70206-8cca-41cd-8897-8516959bc223 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:04.506675 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-64f70206-8cca-41cd-8897-8516959bc223 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:04.516136 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-64f70206-8cca-41cd-8897-8516959bc223 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:04.541789 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-8c03d15a-6574-47a1-b7ac-166749c4809a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:04.556748 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-8c03d15a-6574-47a1-b7ac-166749c4809a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.252635 Nov 02 16:48:04.558469 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 132/266] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:04 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:04.576340 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-efa0ddee-873c-46af-9f6e-230175dbf57d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:04.578051 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-efa0ddee-873c-46af-9f6e-230175dbf57d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:04.587209 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-efa0ddee-873c-46af-9f6e-230175dbf57d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:04.588297 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-efa0ddee-873c-46af-9f6e-230175dbf57d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:04.590177 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-efa0ddee-873c-46af-9f6e-230175dbf57d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:04.591011 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-efa0ddee-873c-46af-9f6e-230175dbf57d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:04.647126 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-64f70206-8cca-41cd-8897-8516959bc223 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:04.657786 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-64f70206-8cca-41cd-8897-8516959bc223 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1271 microversion: 2.1 time: 0.186965 Nov 02 16:48:04.665368 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 135/267] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:04 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:04.730274 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-efa0ddee-873c-46af-9f6e-230175dbf57d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 17659 microversion: 2.1 time: 0.169947 Nov 02 16:48:04.731053 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 133/268] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:04 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 17659 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:04.738914 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1493882865", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "networks": [{"uuid": "716d1add-eeb0-4090-99a3-8e93ac4c3a42"}]}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:04.810212 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-fb9b6041-3323-4b68-bcd1-467c002c5717 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:04.811924 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-fb9b6041-3323-4b68-bcd1-467c002c5717 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:04.836745 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fb9b6041-3323-4b68-bcd1-467c002c5717 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:04.836745 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fb9b6041-3323-4b68-bcd1-467c002c5717 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:04.837616 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fb9b6041-3323-4b68-bcd1-467c002c5717 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:04.837616 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fb9b6041-3323-4b68-bcd1-467c002c5717 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:04.851775 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.network.neutron [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] validate_networks() for [('716d1add-eeb0-4090-99a3-8e93ac4c3a42', None, None, None, None, None)] {{(pid=127649) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:48:04.966998 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-fb9b6041-3323-4b68-bcd1-467c002c5717 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 13324 microversion: 2.20 time: 0.162441 Nov 02 16:48:04.968326 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 134/269] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:04 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 13324 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:05.587275 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2b92c02c-fce4-4b9f-a7dd-a71e6b3c5cc8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:05.588067 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2b92c02c-fce4-4b9f-a7dd-a71e6b3c5cc8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:05.596049 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2b92c02c-fce4-4b9f-a7dd-a71e6b3c5cc8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:05.596545 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2b92c02c-fce4-4b9f-a7dd-a71e6b3c5cc8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:05.597447 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2b92c02c-fce4-4b9f-a7dd-a71e6b3c5cc8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:05.598106 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2b92c02c-fce4-4b9f-a7dd-a71e6b3c5cc8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:05.784510 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2b92c02c-fce4-4b9f-a7dd-a71e6b3c5cc8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:05.795441 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2b92c02c-fce4-4b9f-a7dd-a71e6b3c5cc8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.212621 Nov 02 16:48:05.796590 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 135/270] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:05 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:05.814597 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-49b8a80b-b4b6-47bf-b6c6-45e88cfdc87b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:05.816752 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-49b8a80b-b4b6-47bf-b6c6-45e88cfdc87b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:05.826898 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-49b8a80b-b4b6-47bf-b6c6-45e88cfdc87b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:05.827843 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-49b8a80b-b4b6-47bf-b6c6-45e88cfdc87b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:05.829258 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-49b8a80b-b4b6-47bf-b6c6-45e88cfdc87b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:05.830547 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-49b8a80b-b4b6-47bf-b6c6-45e88cfdc87b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:05.871336 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Flavor limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:48:05.872079 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Image limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:48:05.872880 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Flavor pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:48:05.873398 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Image pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:48:05.874779 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:48:05.897707 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:05.900330 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:05.901744 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:05.902482 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:05.921177 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-49b8a80b-b4b6-47bf-b6c6-45e88cfdc87b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:05.933201 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-49b8a80b-b4b6-47bf-b6c6-45e88cfdc87b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1277 microversion: 2.1 time: 0.135071 Nov 02 16:48:05.935537 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 136/271] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:05 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:05.941242 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ae77ea80-0919-4ff0-ba53-41f5b723657d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:05.942891 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ae77ea80-0919-4ff0-ba53-41f5b723657d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:05.950523 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ae77ea80-0919-4ff0-ba53-41f5b723657d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:05.951860 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ae77ea80-0919-4ff0-ba53-41f5b723657d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:05.953315 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ae77ea80-0919-4ff0-ba53-41f5b723657d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:05.953924 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ae77ea80-0919-4ff0-ba53-41f5b723657d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:05.958203 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Getting quotas for project fd124bfe873f4553b53c6d8282df462c. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:48:05.979975 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Getting quotas for user 3f09374d85e441bea89376debca253d9 and project fd124bfe873f4553b53c6d8282df462c. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:48:06.043492 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Going to run 1 instances... {{(pid=127649) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:48:06.047386 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:48:06.054405 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ae77ea80-0919-4ff0-ba53-41f5b723657d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 18278 microversion: 2.1 time: 0.116988 Nov 02 16:48:06.059281 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 137/272] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:05 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 18278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:06.066481 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a0fd9ffa-1ad4-4d56-a3ac-4f14abe2e363 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:06.068749 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a0fd9ffa-1ad4-4d56-a3ac-4f14abe2e363 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:06.081110 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0fd9ffa-1ad4-4d56-a3ac-4f14abe2e363 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:06.081750 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0fd9ffa-1ad4-4d56-a3ac-4f14abe2e363 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:06.083112 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0fd9ffa-1ad4-4d56-a3ac-4f14abe2e363 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:06.083896 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0fd9ffa-1ad4-4d56-a3ac-4f14abe2e363 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:06.142817 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-654aa529-a6bb-4774-9470-423ec4e03c8b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.408298 Nov 02 16:48:06.147688 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 136/273] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:48:04 2021] POST /compute/v2.1/servers => generated 382 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:48:06.158581 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0c585906-821e-438e-b550-4f2b40d778b5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:06.159230 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0c585906-821e-438e-b550-4f2b40d778b5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:06.190839 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a0fd9ffa-1ad4-4d56-a3ac-4f14abe2e363 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 16403 microversion: 2.20 time: 0.129203 Nov 02 16:48:06.192242 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 138/274] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:06 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 16403 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:06.277855 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0c585906-821e-438e-b550-4f2b40d778b5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:06.289742 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0c585906-821e-438e-b550-4f2b40d778b5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1222 microversion: 2.1 time: 0.136362 Nov 02 16:48:06.290799 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 137/275] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:06 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:06.817160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2ec57858-3e9a-4de0-88ae-d1c812b370be tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:06.817827 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2ec57858-3e9a-4de0-88ae-d1c812b370be tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:06.832007 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2ec57858-3e9a-4de0-88ae-d1c812b370be tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:06.833683 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2ec57858-3e9a-4de0-88ae-d1c812b370be tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:06.836084 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2ec57858-3e9a-4de0-88ae-d1c812b370be tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:06.837368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2ec57858-3e9a-4de0-88ae-d1c812b370be tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:06.955084 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5cd14be7-2292-478b-825c-150ac84e0fd7 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:06.955956 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5cd14be7-2292-478b-825c-150ac84e0fd7 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:06.976801 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5cd14be7-2292-478b-825c-150ac84e0fd7 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:06.978443 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5cd14be7-2292-478b-825c-150ac84e0fd7 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:06.981362 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5cd14be7-2292-478b-825c-150ac84e0fd7 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:06.982508 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5cd14be7-2292-478b-825c-150ac84e0fd7 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:07.038680 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2ec57858-3e9a-4de0-88ae-d1c812b370be tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:07.047606 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2ec57858-3e9a-4de0-88ae-d1c812b370be tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.235827 Nov 02 16:48:07.048139 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 139/276] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:06 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:07.068037 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d069f204-ed51-4749-b2f5-df500ef4b60f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:07.069109 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d069f204-ed51-4749-b2f5-df500ef4b60f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:07.077862 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d069f204-ed51-4749-b2f5-df500ef4b60f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:07.078329 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d069f204-ed51-4749-b2f5-df500ef4b60f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:07.079159 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d069f204-ed51-4749-b2f5-df500ef4b60f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:07.079620 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d069f204-ed51-4749-b2f5-df500ef4b60f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:07.188576 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d069f204-ed51-4749-b2f5-df500ef4b60f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 19342 microversion: 2.1 time: 0.125226 Nov 02 16:48:07.190342 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 140/277] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:07 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 19342 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:48:07.199220 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f0f0615c-20fc-453b-b6d4-042ebd786b30 tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] Calling method '.version_select at 0x7f112ee4e9d0>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:07.266497 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f0f0615c-20fc-453b-b6d4-042ebd786b30 tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/af9ee133-f840-4adc-84f5-9e200002ca32" status: 200 len: 351 microversion: 2.1 time: 0.075789 Nov 02 16:48:07.267850 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 141/278] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:48:07 2021] GET /compute/v2.1/os-volumes/af9ee133-f840-4adc-84f5-9e200002ca32 => generated 351 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:07.273386 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-bc64c125-3612-4bd3-b1d1-85ce5d06b364 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:07.274494 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5cd14be7-2292-478b-825c-150ac84e0fd7 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:07.275291 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-bc64c125-3612-4bd3-b1d1-85ce5d06b364 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:07.286232 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bc64c125-3612-4bd3-b1d1-85ce5d06b364 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:07.287281 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bc64c125-3612-4bd3-b1d1-85ce5d06b364 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:07.288596 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bc64c125-3612-4bd3-b1d1-85ce5d06b364 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:07.289369 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bc64c125-3612-4bd3-b1d1-85ce5d06b364 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:07.296598 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5cd14be7-2292-478b-825c-150ac84e0fd7 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1319 microversion: 2.1 time: 0.347497 Nov 02 16:48:07.302834 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 138/279] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:06 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:07.317004 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8e93c060-a9dd-42db-a05c-41afe1acf26b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:07.317666 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8e93c060-a9dd-42db-a05c-41afe1acf26b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:07.331656 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8e93c060-a9dd-42db-a05c-41afe1acf26b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:07.332283 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8e93c060-a9dd-42db-a05c-41afe1acf26b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:07.333485 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8e93c060-a9dd-42db-a05c-41afe1acf26b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:07.333994 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8e93c060-a9dd-42db-a05c-41afe1acf26b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:07.423166 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-bc64c125-3612-4bd3-b1d1-85ce5d06b364 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 17744 microversion: 2.20 time: 0.153233 Nov 02 16:48:07.425441 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 142/280] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:07 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 17744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:07.437471 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8e93c060-a9dd-42db-a05c-41afe1acf26b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:07.464708 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8e93c060-a9dd-42db-a05c-41afe1acf26b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1274 microversion: 2.1 time: 0.159518 Nov 02 16:48:07.465136 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 139/281] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:07 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:07.897014 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-8b43815f-029b-4437-806a-fa78e2f0215d req-0a326963-37c1-49aa-8605-64bd84771fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d851b6-e607-4ce6-a1d9-ef7d05efdf08", "tag": "a7ecf739-9692-469b-a936-8c8d435d6449"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:07.899144 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:48:07.899144 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:48:07.922977 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-8b43815f-029b-4437-806a-fa78e2f0215d req-0a326963-37c1-49aa-8605-64bd84771fae service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:07.936367 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-8b43815f-029b-4437-806a-fa78e2f0215d req-0a326963-37c1-49aa-8605-64bd84771fae service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:07.960213 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-8b43815f-029b-4437-806a-fa78e2f0215d req-0a326963-37c1-49aa-8605-64bd84771fae service nova] Creating event network-changed:a7ecf739-9692-469b-a936-8c8d435d6449 for instance 50d851b6-e607-4ce6-a1d9-ef7d05efdf08 on hv-cinder-77387 Nov 02 16:48:07.970013 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-8b43815f-029b-4437-806a-fa78e2f0215d req-0a326963-37c1-49aa-8605-64bd84771fae service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079114 Nov 02 16:48:07.976290 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 143/282] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:48:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:08.071141 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a69f7ab2-c34d-4127-9605-7e3581a917da tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:08.072832 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a69f7ab2-c34d-4127-9605-7e3581a917da tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:08.082636 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a69f7ab2-c34d-4127-9605-7e3581a917da tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:08.089579 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a69f7ab2-c34d-4127-9605-7e3581a917da tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:08.090950 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a69f7ab2-c34d-4127-9605-7e3581a917da tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:08.091578 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a69f7ab2-c34d-4127-9605-7e3581a917da tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:08.203559 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0cc1fa5f-bb5b-4df4-9055-a9c7e2c3c22b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:08.205756 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0cc1fa5f-bb5b-4df4-9055-a9c7e2c3c22b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:08.215726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0cc1fa5f-bb5b-4df4-9055-a9c7e2c3c22b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:08.216430 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0cc1fa5f-bb5b-4df4-9055-a9c7e2c3c22b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:08.217310 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0cc1fa5f-bb5b-4df4-9055-a9c7e2c3c22b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:08.217975 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0cc1fa5f-bb5b-4df4-9055-a9c7e2c3c22b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:08.345430 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0cc1fa5f-bb5b-4df4-9055-a9c7e2c3c22b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 20997 microversion: 2.1 time: 0.145181 Nov 02 16:48:08.350303 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 144/283] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:08 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 20997 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:08.358183 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2971ada0-d220-431d-bae1-36bee3f9388b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:08.359699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2971ada0-d220-431d-bae1-36bee3f9388b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:08.376852 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2971ada0-d220-431d-bae1-36bee3f9388b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:08.377716 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2971ada0-d220-431d-bae1-36bee3f9388b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:08.379395 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2971ada0-d220-431d-bae1-36bee3f9388b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:08.380097 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2971ada0-d220-431d-bae1-36bee3f9388b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:08.409842 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a69f7ab2-c34d-4127-9605-7e3581a917da tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:08.430686 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a69f7ab2-c34d-4127-9605-7e3581a917da tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.368328 Nov 02 16:48:08.432470 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 140/284] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:08 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:08.438666 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fb30066b-ac87-446d-8106-2a05ce662e62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:08.440548 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fb30066b-ac87-446d-8106-2a05ce662e62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:08.451300 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fb30066b-ac87-446d-8106-2a05ce662e62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:08.452977 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fb30066b-ac87-446d-8106-2a05ce662e62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:08.454716 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fb30066b-ac87-446d-8106-2a05ce662e62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:08.455956 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fb30066b-ac87-446d-8106-2a05ce662e62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:08.603522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fb30066b-ac87-446d-8106-2a05ce662e62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 18299 microversion: 2.20 time: 0.168559 Nov 02 16:48:08.604693 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 141/285] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:08 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 18299 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:08.617300 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f2e1c8d4-1171-446e-b7ec-7495a5682576 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:08.618854 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f2e1c8d4-1171-446e-b7ec-7495a5682576 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:08.635042 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f2e1c8d4-1171-446e-b7ec-7495a5682576 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:08.635867 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f2e1c8d4-1171-446e-b7ec-7495a5682576 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:08.637728 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f2e1c8d4-1171-446e-b7ec-7495a5682576 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:08.638512 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f2e1c8d4-1171-446e-b7ec-7495a5682576 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:08.763587 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f2e1c8d4-1171-446e-b7ec-7495a5682576 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:08.773900 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f2e1c8d4-1171-446e-b7ec-7495a5682576 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1280 microversion: 2.1 time: 0.166585 Nov 02 16:48:08.774552 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 142/286] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:08 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1280 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:08.779845 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-72bb1597-d185-4e58-889f-5a52231bd801 tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] Calling method '.version_select at 0x7f112f7f4ee0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:08.822530 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2971ada0-d220-431d-bae1-36bee3f9388b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:08.833139 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2971ada0-d220-431d-bae1-36bee3f9388b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1319 microversion: 2.1 time: 0.480791 Nov 02 16:48:08.837801 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 145/287] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:08 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1319 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:08.841754 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-72bb1597-d185-4e58-889f-5a52231bd801 tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/54959867-5d7f-407e-a16b-7d03a6386439" status: 200 len: 351 microversion: 2.1 time: 0.065504 Nov 02 16:48:08.842374 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 143/288] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:48:08 2021] GET /compute/v2.1/os-volumes/54959867-5d7f-407e-a16b-7d03a6386439 => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:09.360410 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4d07aa9c-603e-4320-8a7c-d9e9107d5eee tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:09.363262 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4d07aa9c-603e-4320-8a7c-d9e9107d5eee tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:09.372419 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d07aa9c-603e-4320-8a7c-d9e9107d5eee tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:09.373153 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d07aa9c-603e-4320-8a7c-d9e9107d5eee tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:09.374167 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d07aa9c-603e-4320-8a7c-d9e9107d5eee tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:09.374798 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d07aa9c-603e-4320-8a7c-d9e9107d5eee tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:09.456388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6771f02e-5d62-412c-b01e-3606af1b979a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:09.457986 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6771f02e-5d62-412c-b01e-3606af1b979a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:09.466260 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6771f02e-5d62-412c-b01e-3606af1b979a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:09.466793 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6771f02e-5d62-412c-b01e-3606af1b979a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:09.467841 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6771f02e-5d62-412c-b01e-3606af1b979a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:09.468397 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6771f02e-5d62-412c-b01e-3606af1b979a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:09.507805 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4d07aa9c-603e-4320-8a7c-d9e9107d5eee tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 22021 microversion: 2.1 time: 0.151407 Nov 02 16:48:09.509349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 146/289] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:09 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 22021 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:09.622504 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f84f8336-47d0-4197-ad01-7e82df9c557e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:09.624403 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f84f8336-47d0-4197-ad01-7e82df9c557e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:09.633743 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f84f8336-47d0-4197-ad01-7e82df9c557e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:09.634625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f84f8336-47d0-4197-ad01-7e82df9c557e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:09.635384 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f84f8336-47d0-4197-ad01-7e82df9c557e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:09.635868 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f84f8336-47d0-4197-ad01-7e82df9c557e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:09.679757 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6771f02e-5d62-412c-b01e-3606af1b979a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:09.688527 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6771f02e-5d62-412c-b01e-3606af1b979a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.237703 Nov 02 16:48:09.689212 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 144/290] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:09 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:09.776071 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f84f8336-47d0-4197-ad01-7e82df9c557e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 19342 microversion: 2.20 time: 0.160550 Nov 02 16:48:09.776071 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 147/291] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:09 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 19342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:09.792903 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-08c6467d-2e5f-4565-aa29-5f5249465321 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:09.793689 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-08c6467d-2e5f-4565-aa29-5f5249465321 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:09.801069 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-08c6467d-2e5f-4565-aa29-5f5249465321 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:09.801869 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-08c6467d-2e5f-4565-aa29-5f5249465321 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:09.803286 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-08c6467d-2e5f-4565-aa29-5f5249465321 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:09.803286 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-08c6467d-2e5f-4565-aa29-5f5249465321 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:09.829534 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-903bb73f-a15f-4982-bb81-d3b7133eeef2 req-27ab5a5a-6eb9-4d32-84d4-278785d2a9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdee2c0e-24c6-4a99-8dce-73d69b59a7a2", "tag": "ae21c04d-1584-4ff1-80e2-e50cf95ef8ad"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:09.831857 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:48:09.831857 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:48:09.843304 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-903bb73f-a15f-4982-bb81-d3b7133eeef2 req-27ab5a5a-6eb9-4d32-84d4-278785d2a9b0 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:09.843793 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-903bb73f-a15f-4982-bb81-d3b7133eeef2 req-27ab5a5a-6eb9-4d32-84d4-278785d2a9b0 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:09.868199 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-903bb73f-a15f-4982-bb81-d3b7133eeef2 req-27ab5a5a-6eb9-4d32-84d4-278785d2a9b0 service nova] Creating event network-changed:ae21c04d-1584-4ff1-80e2-e50cf95ef8ad for instance fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 on hv-cinder-77387 Nov 02 16:48:09.876064 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-903bb73f-a15f-4982-bb81-d3b7133eeef2 req-27ab5a5a-6eb9-4d32-84d4-278785d2a9b0 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055393 Nov 02 16:48:09.877028 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 148/292] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:48:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:48:09.882797 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-002b0fed-9002-4b5c-8f55-3aa0e313e84f tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:09.883871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-002b0fed-9002-4b5c-8f55-3aa0e313e84f tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:09.893789 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-002b0fed-9002-4b5c-8f55-3aa0e313e84f tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:09.894632 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-002b0fed-9002-4b5c-8f55-3aa0e313e84f tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:09.895889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-002b0fed-9002-4b5c-8f55-3aa0e313e84f tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:09.896390 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-002b0fed-9002-4b5c-8f55-3aa0e313e84f tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:10.014377 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-08c6467d-2e5f-4565-aa29-5f5249465321 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:10.023583 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-08c6467d-2e5f-4565-aa29-5f5249465321 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1322 microversion: 2.1 time: 0.235485 Nov 02 16:48:10.024259 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 145/293] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:09 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:10.174363 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-002b0fed-9002-4b5c-8f55-3aa0e313e84f tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:10.183069 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-002b0fed-9002-4b5c-8f55-3aa0e313e84f tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1319 microversion: 2.1 time: 0.304855 Nov 02 16:48:10.183720 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 149/294] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:09 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:10.318216 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6d6f5b9b-9400-4719-8d0e-84545d32d587 tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] Calling method '.version_select at 0x7f112f79d9d0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:10.367857 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6d6f5b9b-9400-4719-8d0e-84545d32d587 tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/0d4b97dd-7777-4ecc-83d1-efbd62f133a0" status: 200 len: 351 microversion: 2.1 time: 0.054052 Nov 02 16:48:10.368675 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 146/295] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:48:10 2021] GET /compute/v2.1/os-volumes/0d4b97dd-7777-4ecc-83d1-efbd62f133a0 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:10.380952 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-95a458d7-fd54-4531-bfe7-396b34e5863b tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] Calling method '.version_select at 0x7f112efb2f70>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:10.472246 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-95a458d7-fd54-4531-bfe7-396b34e5863b tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] 10.222.0.118 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.094742 Nov 02 16:48:10.472904 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 150/296] 10.222.0.118 () {58 vars in 1138 bytes} [Tue Nov 2 16:48:10 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:10.485755 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4df09720-5701-43db-9693-b8ecd5578f18 tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] Calling method '.version_select at 0x7f112f7efa60>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:10.520792 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d204b244-14f8-45fc-9e08-b5d591e8accd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:10.523020 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d204b244-14f8-45fc-9e08-b5d591e8accd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:10.534212 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d204b244-14f8-45fc-9e08-b5d591e8accd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:10.534680 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d204b244-14f8-45fc-9e08-b5d591e8accd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:10.535517 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d204b244-14f8-45fc-9e08-b5d591e8accd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:10.535972 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d204b244-14f8-45fc-9e08-b5d591e8accd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:10.573724 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4df09720-5701-43db-9693-b8ecd5578f18 tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] 10.222.0.118 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.092040 Nov 02 16:48:10.574491 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 147/297] 10.222.0.118 () {58 vars in 1153 bytes} [Tue Nov 2 16:48:10 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:10.587918 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-200c5fe6-07ce-4676-a6e7-6c5e22357a3f tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] Calling method '.version_select at 0x7f112f784160>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:10.679845 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-200c5fe6-07ce-4676-a6e7-6c5e22357a3f tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] 10.222.0.118 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.095741 Nov 02 16:48:10.687543 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 148/298] 10.222.0.118 () {58 vars in 1138 bytes} [Tue Nov 2 16:48:10 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:10.693464 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8fb80516-daed-4289-9348-3fbc424c8aad tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] Calling method '.version_select at 0x7f112f756c10>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:10.696945 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d204b244-14f8-45fc-9e08-b5d591e8accd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 22978 microversion: 2.1 time: 0.180851 Nov 02 16:48:10.697684 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 151/299] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:10 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 22978 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:48:10.709226 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cc9c3de3-badc-4add-81c0-5aa2313dae8f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:10.710504 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-cc9c3de3-badc-4add-81c0-5aa2313dae8f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:10.720530 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc9c3de3-badc-4add-81c0-5aa2313dae8f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:10.721007 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc9c3de3-badc-4add-81c0-5aa2313dae8f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:10.722716 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc9c3de3-badc-4add-81c0-5aa2313dae8f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:10.723173 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc9c3de3-badc-4add-81c0-5aa2313dae8f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:10.795428 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8fb80516-daed-4289-9348-3fbc424c8aad tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] 10.222.0.118 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.106514 Nov 02 16:48:10.796098 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 149/300] 10.222.0.118 () {58 vars in 1171 bytes} [Tue Nov 2 16:48:10 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:10.810048 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-008e2c69-c765-43fa-ab8b-35808e84fb16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:10.811236 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-008e2c69-c765-43fa-ab8b-35808e84fb16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:10.819200 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-008e2c69-c765-43fa-ab8b-35808e84fb16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:10.819663 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-008e2c69-c765-43fa-ab8b-35808e84fb16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:10.820737 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-008e2c69-c765-43fa-ab8b-35808e84fb16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:10.821190 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-008e2c69-c765-43fa-ab8b-35808e84fb16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:10.979524 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-008e2c69-c765-43fa-ab8b-35808e84fb16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 20193 microversion: 2.20 time: 0.171792 Nov 02 16:48:10.987118 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 150/301] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:10 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 20193 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:10.997817 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fdcffee0-260c-4f9a-b7a6-ef13c3369f1d tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] Calling method '.version_select at 0x7f112f7cfe50>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:11.000330 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-cc9c3de3-badc-4add-81c0-5aa2313dae8f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:11.011864 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-cc9c3de3-badc-4add-81c0-5aa2313dae8f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.309199 Nov 02 16:48:11.012602 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 152/302] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:10 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:11.042847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ef9b1f3b-5e15-4210-85e6-32ac49c8e6cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:11.043511 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ef9b1f3b-5e15-4210-85e6-32ac49c8e6cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:11.052005 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ef9b1f3b-5e15-4210-85e6-32ac49c8e6cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:11.052521 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ef9b1f3b-5e15-4210-85e6-32ac49c8e6cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:11.053403 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ef9b1f3b-5e15-4210-85e6-32ac49c8e6cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:11.053865 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ef9b1f3b-5e15-4210-85e6-32ac49c8e6cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:11.136563 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fdcffee0-260c-4f9a-b7a6-ef13c3369f1d tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.142844 Nov 02 16:48:11.137774 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 151/303] 10.222.0.118 () {58 vars in 1174 bytes} [Tue Nov 2 16:48:10 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:11.152743 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-71bb5efc-708d-411e-8148-26ea51de183c tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] Calling method '.version_select at 0x7f112f7f4160>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:11.254991 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-71bb5efc-708d-411e-8148-26ea51de183c tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.106859 Nov 02 16:48:11.255880 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 152/304] 10.222.0.118 () {58 vars in 1159 bytes} [Tue Nov 2 16:48:11 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:11.264788 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7da77ee8-2005-4776-8f63-8b55c5168f61 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:11.266198 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7da77ee8-2005-4776-8f63-8b55c5168f61 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:11.274640 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7da77ee8-2005-4776-8f63-8b55c5168f61 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:11.276208 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7da77ee8-2005-4776-8f63-8b55c5168f61 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:11.277579 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7da77ee8-2005-4776-8f63-8b55c5168f61 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:11.278390 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7da77ee8-2005-4776-8f63-8b55c5168f61 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:11.516825 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7da77ee8-2005-4776-8f63-8b55c5168f61 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:11.527988 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7da77ee8-2005-4776-8f63-8b55c5168f61 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1319 microversion: 2.1 time: 0.270289 Nov 02 16:48:11.528775 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 153/305] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:11 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:11.540803 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-edea3330-7418-4266-8499-8fe240571564 tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] Calling method '.version_select at 0x7f112f7a0ee0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:11.620208 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ef9b1f3b-5e15-4210-85e6-32ac49c8e6cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:11.626600 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-edea3330-7418-4266-8499-8fe240571564 tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.096432 Nov 02 16:48:11.627263 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 154/306] 10.222.0.118 () {58 vars in 1192 bytes} [Tue Nov 2 16:48:11 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:11.640048 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ef9b1f3b-5e15-4210-85e6-32ac49c8e6cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1322 microversion: 2.1 time: 0.600016 Nov 02 16:48:11.645870 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 153/307] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:11 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:11.649846 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6a154db7-4b0e-476d-b22f-b20877f1c59d tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] Calling method '.version_select at 0x7f112f7fdb80>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:11.712385 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-76a07f19-9b03-4744-b4f3-1b7f56aba81e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:11.713429 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-76a07f19-9b03-4744-b4f3-1b7f56aba81e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:11.720811 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-76a07f19-9b03-4744-b4f3-1b7f56aba81e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:11.721602 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-76a07f19-9b03-4744-b4f3-1b7f56aba81e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:11.723238 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-76a07f19-9b03-4744-b4f3-1b7f56aba81e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:11.724100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-76a07f19-9b03-4744-b4f3-1b7f56aba81e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:11.756529 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6a154db7-4b0e-476d-b22f-b20877f1c59d tempest-VolumesTestJSON-2615691 tempest-VolumesTestJSON-2615691-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.114892 Nov 02 16:48:11.774128 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 155/308] 10.222.0.118 () {58 vars in 1159 bytes} [Tue Nov 2 16:48:11 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:11.869561 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-76a07f19-9b03-4744-b4f3-1b7f56aba81e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 23598 microversion: 2.1 time: 0.163714 Nov 02 16:48:11.870626 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 154/309] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:11 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 23598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:48:11.997074 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3b23a865-b7f2-4d1c-80de-3e5b32555da6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:11.998066 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3b23a865-b7f2-4d1c-80de-3e5b32555da6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:12.006646 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3b23a865-b7f2-4d1c-80de-3e5b32555da6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:12.007112 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3b23a865-b7f2-4d1c-80de-3e5b32555da6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:12.008296 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3b23a865-b7f2-4d1c-80de-3e5b32555da6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:12.008734 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3b23a865-b7f2-4d1c-80de-3e5b32555da6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:12.035726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e52b2188-7a68-4b94-9342-eeaac35bd75e tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:12.036762 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e52b2188-7a68-4b94-9342-eeaac35bd75e tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:12.045927 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e52b2188-7a68-4b94-9342-eeaac35bd75e tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:12.046533 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e52b2188-7a68-4b94-9342-eeaac35bd75e tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:12.047399 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e52b2188-7a68-4b94-9342-eeaac35bd75e tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:12.047856 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e52b2188-7a68-4b94-9342-eeaac35bd75e tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:12.166850 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3b23a865-b7f2-4d1c-80de-3e5b32555da6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 21519 microversion: 2.20 time: 0.175371 Nov 02 16:48:12.171168 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 156/310] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:11 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 21519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:12.232854 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e52b2188-7a68-4b94-9342-eeaac35bd75e tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:12.244658 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e52b2188-7a68-4b94-9342-eeaac35bd75e tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.216793 Nov 02 16:48:12.245783 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 155/311] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:12 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:12.551202 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9adb5b4f-01ec-47b8-8a4e-6c865471ed9b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:12.551978 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9adb5b4f-01ec-47b8-8a4e-6c865471ed9b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:12.559622 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9adb5b4f-01ec-47b8-8a4e-6c865471ed9b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:12.560094 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9adb5b4f-01ec-47b8-8a4e-6c865471ed9b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:12.560943 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9adb5b4f-01ec-47b8-8a4e-6c865471ed9b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:12.561389 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9adb5b4f-01ec-47b8-8a4e-6c865471ed9b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:12.657307 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b7b1e2a8-74ac-4735-8173-36bf51996ade tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:12.658025 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b7b1e2a8-74ac-4735-8173-36bf51996ade tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:12.666317 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b7b1e2a8-74ac-4735-8173-36bf51996ade tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:12.666788 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b7b1e2a8-74ac-4735-8173-36bf51996ade tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:12.667613 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b7b1e2a8-74ac-4735-8173-36bf51996ade tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:12.668055 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b7b1e2a8-74ac-4735-8173-36bf51996ade tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:12.722996 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-9adb5b4f-01ec-47b8-8a4e-6c865471ed9b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:12.731428 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9adb5b4f-01ec-47b8-8a4e-6c865471ed9b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1319 microversion: 2.1 time: 0.185402 Nov 02 16:48:12.732484 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 157/312] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:12 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:12.828822 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b7b1e2a8-74ac-4735-8173-36bf51996ade tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:12.837705 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b7b1e2a8-74ac-4735-8173-36bf51996ade tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1322 microversion: 2.1 time: 0.184563 Nov 02 16:48:12.838449 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 156/313] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:12 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:12.883992 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c547fca5-2a22-47da-9475-228a960742b3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:12.885154 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c547fca5-2a22-47da-9475-228a960742b3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:12.892666 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c547fca5-2a22-47da-9475-228a960742b3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:12.893283 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c547fca5-2a22-47da-9475-228a960742b3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:12.894521 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c547fca5-2a22-47da-9475-228a960742b3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:12.895233 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c547fca5-2a22-47da-9475-228a960742b3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:13.020745 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c547fca5-2a22-47da-9475-228a960742b3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 23799 microversion: 2.1 time: 0.140934 Nov 02 16:48:13.024815 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 158/314] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:12 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 23799 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:13.180913 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0db7c353-cb36-4a57-a7ae-8d2f4d032b75 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:13.182307 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0db7c353-cb36-4a57-a7ae-8d2f4d032b75 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:13.190235 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0db7c353-cb36-4a57-a7ae-8d2f4d032b75 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:13.191467 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0db7c353-cb36-4a57-a7ae-8d2f4d032b75 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:13.193100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0db7c353-cb36-4a57-a7ae-8d2f4d032b75 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:13.193696 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0db7c353-cb36-4a57-a7ae-8d2f4d032b75 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:13.266081 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5cda7622-002d-48db-a808-b00c7f113f95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:13.267117 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5cda7622-002d-48db-a808-b00c7f113f95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:13.276978 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5cda7622-002d-48db-a808-b00c7f113f95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:13.277728 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5cda7622-002d-48db-a808-b00c7f113f95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:13.278740 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5cda7622-002d-48db-a808-b00c7f113f95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:13.279420 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5cda7622-002d-48db-a808-b00c7f113f95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:13.344690 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0db7c353-cb36-4a57-a7ae-8d2f4d032b75 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 22393 microversion: 2.20 time: 0.168186 Nov 02 16:48:13.354436 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 157/315] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:13 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 22393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:13.672465 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5cda7622-002d-48db-a808-b00c7f113f95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:13.682570 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5cda7622-002d-48db-a808-b00c7f113f95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.421504 Nov 02 16:48:13.683351 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 159/316] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:13 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:13.750981 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ba9fe2e5-bc9b-4412-a326-5ceb3a74c8ff tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:13.751734 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ba9fe2e5-bc9b-4412-a326-5ceb3a74c8ff tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:13.760663 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ba9fe2e5-bc9b-4412-a326-5ceb3a74c8ff tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:13.761058 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ba9fe2e5-bc9b-4412-a326-5ceb3a74c8ff tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:13.762141 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ba9fe2e5-bc9b-4412-a326-5ceb3a74c8ff tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:13.762628 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ba9fe2e5-bc9b-4412-a326-5ceb3a74c8ff tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:13.855880 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-92358e8c-bc54-48a5-80ef-d55c6b8619cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:13.856547 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-92358e8c-bc54-48a5-80ef-d55c6b8619cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:13.865569 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-92358e8c-bc54-48a5-80ef-d55c6b8619cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:13.866376 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-92358e8c-bc54-48a5-80ef-d55c6b8619cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:13.867187 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-92358e8c-bc54-48a5-80ef-d55c6b8619cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:13.867804 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-92358e8c-bc54-48a5-80ef-d55c6b8619cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:13.933615 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ba9fe2e5-bc9b-4412-a326-5ceb3a74c8ff tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:13.945947 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ba9fe2e5-bc9b-4412-a326-5ceb3a74c8ff tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1319 microversion: 2.1 time: 0.199462 Nov 02 16:48:13.947062 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 158/317] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:13 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:14.047714 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ba1b4474-36a1-4cc5-b2ef-7f0b5ac00697 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:14.049371 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ba1b4474-36a1-4cc5-b2ef-7f0b5ac00697 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:14.052932 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-92358e8c-bc54-48a5-80ef-d55c6b8619cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:14.070714 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ba1b4474-36a1-4cc5-b2ef-7f0b5ac00697 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:14.071187 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ba1b4474-36a1-4cc5-b2ef-7f0b5ac00697 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:14.071887 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-92358e8c-bc54-48a5-80ef-d55c6b8619cb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1322 microversion: 2.1 time: 0.219604 Nov 02 16:48:14.073516 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 160/318] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:13 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:14.082130 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ba1b4474-36a1-4cc5-b2ef-7f0b5ac00697 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:14.082856 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ba1b4474-36a1-4cc5-b2ef-7f0b5ac00697 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:14.253113 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ba1b4474-36a1-4cc5-b2ef-7f0b5ac00697 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 24370 microversion: 2.1 time: 0.222825 Nov 02 16:48:14.258376 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 159/319] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:14 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 24370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:48:14.362063 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-58bdb327-a103-4cbb-a75d-dc67b631dfcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:14.364076 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-58bdb327-a103-4cbb-a75d-dc67b631dfcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:14.372294 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-58bdb327-a103-4cbb-a75d-dc67b631dfcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:14.372831 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-58bdb327-a103-4cbb-a75d-dc67b631dfcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:14.373822 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-58bdb327-a103-4cbb-a75d-dc67b631dfcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:14.374377 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-58bdb327-a103-4cbb-a75d-dc67b631dfcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:14.522078 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-58bdb327-a103-4cbb-a75d-dc67b631dfcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 23051 microversion: 2.20 time: 0.164961 Nov 02 16:48:14.522813 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 161/320] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:14 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 23051 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:14.704366 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5455059c-17ca-4cdf-8eab-add33d5c59ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:14.705486 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5455059c-17ca-4cdf-8eab-add33d5c59ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:14.715760 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5455059c-17ca-4cdf-8eab-add33d5c59ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:14.716270 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5455059c-17ca-4cdf-8eab-add33d5c59ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:14.717518 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5455059c-17ca-4cdf-8eab-add33d5c59ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:14.717976 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5455059c-17ca-4cdf-8eab-add33d5c59ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:14.905042 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5455059c-17ca-4cdf-8eab-add33d5c59ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:14.913987 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5455059c-17ca-4cdf-8eab-add33d5c59ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.214560 Nov 02 16:48:14.914643 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 160/321] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:14 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:14.965822 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-98817bc1-37f7-429b-8b1c-b0b9de6f41f6 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:14.966600 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-98817bc1-37f7-429b-8b1c-b0b9de6f41f6 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:14.974941 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-98817bc1-37f7-429b-8b1c-b0b9de6f41f6 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:14.975410 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-98817bc1-37f7-429b-8b1c-b0b9de6f41f6 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:14.976263 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-98817bc1-37f7-429b-8b1c-b0b9de6f41f6 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:14.976710 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-98817bc1-37f7-429b-8b1c-b0b9de6f41f6 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:15.091404 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-27664818-2981-4d4c-adf1-1a6e786d2ca5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:15.092068 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-27664818-2981-4d4c-adf1-1a6e786d2ca5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:15.100659 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-27664818-2981-4d4c-adf1-1a6e786d2ca5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:15.101483 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-27664818-2981-4d4c-adf1-1a6e786d2ca5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:15.102363 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-27664818-2981-4d4c-adf1-1a6e786d2ca5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:15.102823 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-27664818-2981-4d4c-adf1-1a6e786d2ca5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:15.147052 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-98817bc1-37f7-429b-8b1c-b0b9de6f41f6 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:15.156537 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-98817bc1-37f7-429b-8b1c-b0b9de6f41f6 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1319 microversion: 2.1 time: 0.195278 Nov 02 16:48:15.157527 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 162/322] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:14 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:15.271948 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-38873a8c-8337-4a1e-934a-ab5a6015e1fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:15.273641 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-38873a8c-8337-4a1e-934a-ab5a6015e1fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:15.283948 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-38873a8c-8337-4a1e-934a-ab5a6015e1fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:15.284657 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-38873a8c-8337-4a1e-934a-ab5a6015e1fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:15.285486 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-38873a8c-8337-4a1e-934a-ab5a6015e1fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:15.286001 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-38873a8c-8337-4a1e-934a-ab5a6015e1fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:15.344057 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-27664818-2981-4d4c-adf1-1a6e786d2ca5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:15.363489 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-27664818-2981-4d4c-adf1-1a6e786d2ca5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1322 microversion: 2.1 time: 0.275194 Nov 02 16:48:15.380481 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 161/323] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:15 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:15.429663 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-38873a8c-8337-4a1e-934a-ab5a6015e1fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 24918 microversion: 2.1 time: 0.166233 Nov 02 16:48:15.434961 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 163/324] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:15 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 24918 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:15.535587 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a4384234-0cc8-4acb-9513-b474e8da00b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:15.536536 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a4384234-0cc8-4acb-9513-b474e8da00b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:15.543220 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a4384234-0cc8-4acb-9513-b474e8da00b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:15.543697 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a4384234-0cc8-4acb-9513-b474e8da00b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:15.544580 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a4384234-0cc8-4acb-9513-b474e8da00b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:15.545037 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a4384234-0cc8-4acb-9513-b474e8da00b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:15.671816 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a4384234-0cc8-4acb-9513-b474e8da00b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 23810 microversion: 2.20 time: 0.140157 Nov 02 16:48:15.673581 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 162/325] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:15 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 23810 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:15.933389 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8875d51e-2617-46d2-b92b-235193936731 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:15.934296 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8875d51e-2617-46d2-b92b-235193936731 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:15.942783 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8875d51e-2617-46d2-b92b-235193936731 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:15.943365 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8875d51e-2617-46d2-b92b-235193936731 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:15.944815 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8875d51e-2617-46d2-b92b-235193936731 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:15.945511 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8875d51e-2617-46d2-b92b-235193936731 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:16.165294 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8875d51e-2617-46d2-b92b-235193936731 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:16.185697 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c791ad38-38fe-4b25-9d98-adbd46392444 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:16.189242 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c791ad38-38fe-4b25-9d98-adbd46392444 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:16.198849 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8875d51e-2617-46d2-b92b-235193936731 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.270307 Nov 02 16:48:16.217833 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 164/326] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:15 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:16.220582 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c791ad38-38fe-4b25-9d98-adbd46392444 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:16.230642 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c791ad38-38fe-4b25-9d98-adbd46392444 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:16.231868 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c791ad38-38fe-4b25-9d98-adbd46392444 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:16.232998 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c791ad38-38fe-4b25-9d98-adbd46392444 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:16.395609 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a2d5d73a-d473-456e-b4b6-2142a03a1165 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:16.396704 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a2d5d73a-d473-456e-b4b6-2142a03a1165 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:16.405867 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a2d5d73a-d473-456e-b4b6-2142a03a1165 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:16.406348 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a2d5d73a-d473-456e-b4b6-2142a03a1165 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:16.407187 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a2d5d73a-d473-456e-b4b6-2142a03a1165 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:16.407624 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a2d5d73a-d473-456e-b4b6-2142a03a1165 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:16.413120 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-c791ad38-38fe-4b25-9d98-adbd46392444 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:16.429832 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c791ad38-38fe-4b25-9d98-adbd46392444 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1319 microversion: 2.1 time: 0.252574 Nov 02 16:48:16.430983 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 163/327] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:16 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:16.444419 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-44f5810f-70c0-4ed8-b38a-02b2ba0d5399 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:16.445806 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-44f5810f-70c0-4ed8-b38a-02b2ba0d5399 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:16.454284 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-44f5810f-70c0-4ed8-b38a-02b2ba0d5399 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:16.454738 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-44f5810f-70c0-4ed8-b38a-02b2ba0d5399 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:16.455785 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-44f5810f-70c0-4ed8-b38a-02b2ba0d5399 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:16.456262 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-44f5810f-70c0-4ed8-b38a-02b2ba0d5399 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:16.583827 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a2d5d73a-d473-456e-b4b6-2142a03a1165 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:16.587022 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-44f5810f-70c0-4ed8-b38a-02b2ba0d5399 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 25738 microversion: 2.1 time: 0.147561 Nov 02 16:48:16.592317 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 164/328] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:16 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 25738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:16.599185 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a2d5d73a-d473-456e-b4b6-2142a03a1165 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1322 microversion: 2.1 time: 0.213587 Nov 02 16:48:16.599848 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 165/329] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:16 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:16.689499 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1848c4d7-0646-463e-816c-ad6b98c46aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:16.691036 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1848c4d7-0646-463e-816c-ad6b98c46aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:16.699829 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1848c4d7-0646-463e-816c-ad6b98c46aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:16.705652 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1848c4d7-0646-463e-816c-ad6b98c46aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:16.705652 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1848c4d7-0646-463e-816c-ad6b98c46aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:16.705652 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1848c4d7-0646-463e-816c-ad6b98c46aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:16.852693 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1848c4d7-0646-463e-816c-ad6b98c46aa1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 24317 microversion: 2.20 time: 0.169367 Nov 02 16:48:16.853995 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 165/330] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:16 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 24317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:17.222357 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-288d4b98-96df-46a7-a920-31ff64447dde tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:17.224374 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-288d4b98-96df-46a7-a920-31ff64447dde tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:17.232920 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-288d4b98-96df-46a7-a920-31ff64447dde tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:17.233862 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-288d4b98-96df-46a7-a920-31ff64447dde tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:17.235934 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-288d4b98-96df-46a7-a920-31ff64447dde tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:17.237078 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-288d4b98-96df-46a7-a920-31ff64447dde tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:17.345916 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-fd8ecdde-0d49-43f1-b4e7-494c33d7ee0b req-91665e13-b380-491e-b296-deec0e4e3fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d851b6-e607-4ce6-a1d9-ef7d05efdf08", "name": "network-vif-plugged", "status": "completed", "tag": "a7ecf739-9692-469b-a936-8c8d435d6449"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:17.348372 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:48:17.348372 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:48:17.359901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-fd8ecdde-0d49-43f1-b4e7-494c33d7ee0b req-91665e13-b380-491e-b296-deec0e4e3fd3 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:17.360414 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-fd8ecdde-0d49-43f1-b4e7-494c33d7ee0b req-91665e13-b380-491e-b296-deec0e4e3fd3 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:17.376379 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-fd8ecdde-0d49-43f1-b4e7-494c33d7ee0b req-91665e13-b380-491e-b296-deec0e4e3fd3 service nova] Creating event network-vif-plugged:a7ecf739-9692-469b-a936-8c8d435d6449 for instance 50d851b6-e607-4ce6-a1d9-ef7d05efdf08 on hv-cinder-77387 Nov 02 16:48:17.383901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-fd8ecdde-0d49-43f1-b4e7-494c33d7ee0b req-91665e13-b380-491e-b296-deec0e4e3fd3 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043077 Nov 02 16:48:17.384637 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 166/331] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:48:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:17.460559 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e18b41ac-fc4b-4659-9394-0ad19163589a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:17.473490 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e18b41ac-fc4b-4659-9394-0ad19163589a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:17.481895 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e18b41ac-fc4b-4659-9394-0ad19163589a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:17.482402 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e18b41ac-fc4b-4659-9394-0ad19163589a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:17.489406 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e18b41ac-fc4b-4659-9394-0ad19163589a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:17.489896 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e18b41ac-fc4b-4659-9394-0ad19163589a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:17.546713 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-288d4b98-96df-46a7-a920-31ff64447dde tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:17.561484 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-288d4b98-96df-46a7-a920-31ff64447dde tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.344495 Nov 02 16:48:17.571287 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 166/332] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:17 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:17.602891 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-79645aec-33db-4ee2-8739-3dee8fd8584e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:17.604217 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-79645aec-33db-4ee2-8739-3dee8fd8584e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:17.622182 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-79645aec-33db-4ee2-8739-3dee8fd8584e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:17.633051 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-79645aec-33db-4ee2-8739-3dee8fd8584e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:17.634031 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-79645aec-33db-4ee2-8739-3dee8fd8584e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:17.634484 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-79645aec-33db-4ee2-8739-3dee8fd8584e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:17.781548 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-79645aec-33db-4ee2-8739-3dee8fd8584e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 26529 microversion: 2.1 time: 0.183349 Nov 02 16:48:17.784901 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 167/333] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:17 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 26529 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:48:17.808736 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5d67fcb1-4694-403d-b47a-38e2722126eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:17.811013 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5d67fcb1-4694-403d-b47a-38e2722126eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:17.837202 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5d67fcb1-4694-403d-b47a-38e2722126eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:17.838154 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5d67fcb1-4694-403d-b47a-38e2722126eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:17.839253 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5d67fcb1-4694-403d-b47a-38e2722126eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:17.839387 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e18b41ac-fc4b-4659-9394-0ad19163589a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:17.840129 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5d67fcb1-4694-403d-b47a-38e2722126eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:17.856909 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e18b41ac-fc4b-4659-9394-0ad19163589a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1319 microversion: 2.1 time: 0.408035 Nov 02 16:48:17.857607 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 167/334] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:17 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:17.875022 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6b727169-8a4e-4456-94b7-809affc8917d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:17.876534 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6b727169-8a4e-4456-94b7-809affc8917d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:17.885738 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6b727169-8a4e-4456-94b7-809affc8917d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:17.887104 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6b727169-8a4e-4456-94b7-809affc8917d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:17.890187 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6b727169-8a4e-4456-94b7-809affc8917d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:17.891039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6b727169-8a4e-4456-94b7-809affc8917d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:18.176170 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5d67fcb1-4694-403d-b47a-38e2722126eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:18.195443 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5d67fcb1-4694-403d-b47a-38e2722126eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1322 microversion: 2.1 time: 0.407427 Nov 02 16:48:18.206566 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 168/335] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:17 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:18.320449 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6b727169-8a4e-4456-94b7-809affc8917d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 25210 microversion: 2.20 time: 0.451324 Nov 02 16:48:18.321943 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 168/336] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:17 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 25210 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:18.595700 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b0a5eded-d901-4585-bc1c-6b41e5b25d95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:18.605912 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b0a5eded-d901-4585-bc1c-6b41e5b25d95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:18.625412 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b0a5eded-d901-4585-bc1c-6b41e5b25d95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:18.626641 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b0a5eded-d901-4585-bc1c-6b41e5b25d95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:18.629719 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b0a5eded-d901-4585-bc1c-6b41e5b25d95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:18.630907 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b0a5eded-d901-4585-bc1c-6b41e5b25d95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:18.814273 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6e5a505a-486f-4cda-a8ed-09f8d014f432 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:18.820469 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6e5a505a-486f-4cda-a8ed-09f8d014f432 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:18.863203 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6e5a505a-486f-4cda-a8ed-09f8d014f432 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:18.865567 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6e5a505a-486f-4cda-a8ed-09f8d014f432 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:18.867077 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6e5a505a-486f-4cda-a8ed-09f8d014f432 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:18.877172 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b0a5eded-d901-4585-bc1c-6b41e5b25d95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:18.879842 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6e5a505a-486f-4cda-a8ed-09f8d014f432 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:18.884881 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b0a5eded-d901-4585-bc1c-6b41e5b25d95 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.299410 Nov 02 16:48:18.885777 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 169/337] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:18 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:18.890991 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ffa1d0de-4966-4f27-aac6-13e1eacebe5e tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:18.891856 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ffa1d0de-4966-4f27-aac6-13e1eacebe5e tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:18.899638 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ffa1d0de-4966-4f27-aac6-13e1eacebe5e tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:18.900308 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ffa1d0de-4966-4f27-aac6-13e1eacebe5e tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:18.901143 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ffa1d0de-4966-4f27-aac6-13e1eacebe5e tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:18.901591 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ffa1d0de-4966-4f27-aac6-13e1eacebe5e tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:19.053288 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ffa1d0de-4966-4f27-aac6-13e1eacebe5e tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:19.061659 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ffa1d0de-4966-4f27-aac6-13e1eacebe5e tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1319 microversion: 2.1 time: 0.174450 Nov 02 16:48:19.062309 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 170/338] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:18 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:19.216880 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f580757b-a50e-47cb-9461-5022a9306d90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:19.217852 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f580757b-a50e-47cb-9461-5022a9306d90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:19.227067 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f580757b-a50e-47cb-9461-5022a9306d90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:19.227683 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f580757b-a50e-47cb-9461-5022a9306d90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:19.228752 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f580757b-a50e-47cb-9461-5022a9306d90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:19.229204 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f580757b-a50e-47cb-9461-5022a9306d90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:19.443635 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f580757b-a50e-47cb-9461-5022a9306d90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:19.452340 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f580757b-a50e-47cb-9461-5022a9306d90 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1322 microversion: 2.1 time: 0.240555 Nov 02 16:48:19.452989 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 171/339] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:19 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:19.458677 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a70f294e-e959-4d79-b756-68b4054f6c2d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:19.459688 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a70f294e-e959-4d79-b756-68b4054f6c2d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:19.467072 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a70f294e-e959-4d79-b756-68b4054f6c2d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:19.467529 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a70f294e-e959-4d79-b756-68b4054f6c2d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:19.468388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a70f294e-e959-4d79-b756-68b4054f6c2d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:19.469032 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a70f294e-e959-4d79-b756-68b4054f6c2d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:21.858704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6e5a505a-486f-4cda-a8ed-09f8d014f432 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 27794 microversion: 2.1 time: 3.064636 Nov 02 16:48:21.860034 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 169/340] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:18 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 27794 bytes in 3068 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:21.865728 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-fc929c6c-7333-4349-8e06-509a078be111 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:21.866583 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-fc929c6c-7333-4349-8e06-509a078be111 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:21.878367 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fc929c6c-7333-4349-8e06-509a078be111 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:21.878367 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fc929c6c-7333-4349-8e06-509a078be111 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:21.878913 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fc929c6c-7333-4349-8e06-509a078be111 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:21.879306 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fc929c6c-7333-4349-8e06-509a078be111 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:21.886372 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a70f294e-e959-4d79-b756-68b4054f6c2d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 27295 microversion: 2.20 time: 2.431652 Nov 02 16:48:21.892741 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 172/341] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:19 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 27295 bytes in 2439 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:21.918089 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-bba337c5-600e-409a-b539-b8e2f015287a req-e64e824b-f5fe-42ab-90c9-1ce8b0699eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdee2c0e-24c6-4a99-8dce-73d69b59a7a2", "name": "network-vif-plugged", "status": "completed", "tag": "ae21c04d-1584-4ff1-80e2-e50cf95ef8ad"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:21.919921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:48:21.919921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:48:21.947993 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-bba337c5-600e-409a-b539-b8e2f015287a req-e64e824b-f5fe-42ab-90c9-1ce8b0699eb9 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:21.949170 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-bba337c5-600e-409a-b539-b8e2f015287a req-e64e824b-f5fe-42ab-90c9-1ce8b0699eb9 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:21.965920 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-bba337c5-600e-409a-b539-b8e2f015287a req-e64e824b-f5fe-42ab-90c9-1ce8b0699eb9 service nova] Creating event network-vif-plugged:ae21c04d-1584-4ff1-80e2-e50cf95ef8ad for instance fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 on hv-cinder-77387 Nov 02 16:48:21.972309 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-bba337c5-600e-409a-b539-b8e2f015287a req-e64e824b-f5fe-42ab-90c9-1ce8b0699eb9 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070125 Nov 02 16:48:21.972994 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 173/342] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:48:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:21.980757 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2b435209-28d0-4c9a-963b-db2061f0305b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:21.981485 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2b435209-28d0-4c9a-963b-db2061f0305b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:21.991221 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2b435209-28d0-4c9a-963b-db2061f0305b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:21.991793 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2b435209-28d0-4c9a-963b-db2061f0305b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:21.992773 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2b435209-28d0-4c9a-963b-db2061f0305b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:21.993345 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2b435209-28d0-4c9a-963b-db2061f0305b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:22.051434 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-fc929c6c-7333-4349-8e06-509a078be111 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:22.060994 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-fc929c6c-7333-4349-8e06-509a078be111 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.199766 Nov 02 16:48:22.062115 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 170/343] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:21 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:22.071052 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-44af3a54-5648-4a98-ad35-b1017bcb8449 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:22.072767 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-44af3a54-5648-4a98-ad35-b1017bcb8449 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:22.089700 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-44af3a54-5648-4a98-ad35-b1017bcb8449 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:22.091497 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-44af3a54-5648-4a98-ad35-b1017bcb8449 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:22.092829 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-44af3a54-5648-4a98-ad35-b1017bcb8449 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:22.093802 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-44af3a54-5648-4a98-ad35-b1017bcb8449 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:22.200727 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2b435209-28d0-4c9a-963b-db2061f0305b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:22.211255 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2b435209-28d0-4c9a-963b-db2061f0305b tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1319 microversion: 2.1 time: 0.236578 Nov 02 16:48:22.213324 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 174/344] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:21 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:22.307076 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-44af3a54-5648-4a98-ad35-b1017bcb8449 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:22.318558 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-44af3a54-5648-4a98-ad35-b1017bcb8449 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1322 microversion: 2.1 time: 0.254931 Nov 02 16:48:22.319448 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 171/345] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:22 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:22.871944 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7303ae4e-c23c-4611-a5d1-411ee8c17944 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:22.873217 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7303ae4e-c23c-4611-a5d1-411ee8c17944 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:22.881090 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7303ae4e-c23c-4611-a5d1-411ee8c17944 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:22.881554 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7303ae4e-c23c-4611-a5d1-411ee8c17944 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:22.882393 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7303ae4e-c23c-4611-a5d1-411ee8c17944 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:22.882846 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7303ae4e-c23c-4611-a5d1-411ee8c17944 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:22.914050 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e86ed08a-833b-40de-b5de-2d7e6c31070c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:22.915340 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e86ed08a-833b-40de-b5de-2d7e6c31070c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:22.924780 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e86ed08a-833b-40de-b5de-2d7e6c31070c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:22.925256 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e86ed08a-833b-40de-b5de-2d7e6c31070c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:22.926098 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e86ed08a-833b-40de-b5de-2d7e6c31070c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:22.926542 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e86ed08a-833b-40de-b5de-2d7e6c31070c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:23.069808 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7303ae4e-c23c-4611-a5d1-411ee8c17944 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28009 microversion: 2.1 time: 0.202248 Nov 02 16:48:23.070523 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 175/346] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:22 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28009 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:48:23.081831 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-62fb8e97-a6a5-4c07-b39d-9335e6a9b2ff tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:23.082667 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-62fb8e97-a6a5-4c07-b39d-9335e6a9b2ff tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:23.091867 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-62fb8e97-a6a5-4c07-b39d-9335e6a9b2ff tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:23.092379 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-62fb8e97-a6a5-4c07-b39d-9335e6a9b2ff tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:23.093288 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-62fb8e97-a6a5-4c07-b39d-9335e6a9b2ff tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:23.093739 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-62fb8e97-a6a5-4c07-b39d-9335e6a9b2ff tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:23.138860 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e86ed08a-833b-40de-b5de-2d7e6c31070c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 27641 microversion: 2.20 time: 0.241540 Nov 02 16:48:23.139590 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 172/347] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:22 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 27641 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:23.230786 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-fafb26f5-a27b-4462-b6a9-6cabdef1ba63 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:23.232341 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-fafb26f5-a27b-4462-b6a9-6cabdef1ba63 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:23.266140 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fafb26f5-a27b-4462-b6a9-6cabdef1ba63 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:23.266140 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fafb26f5-a27b-4462-b6a9-6cabdef1ba63 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:23.266140 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fafb26f5-a27b-4462-b6a9-6cabdef1ba63 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:23.266140 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fafb26f5-a27b-4462-b6a9-6cabdef1ba63 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:23.307111 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-62fb8e97-a6a5-4c07-b39d-9335e6a9b2ff tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:23.320261 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-62fb8e97-a6a5-4c07-b39d-9335e6a9b2ff tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.243169 Nov 02 16:48:23.322028 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 176/348] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:23 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:23.339453 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b0303a99-3379-4f99-9cd2-58c62af75827 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:23.340095 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b0303a99-3379-4f99-9cd2-58c62af75827 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:23.353122 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b0303a99-3379-4f99-9cd2-58c62af75827 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:23.357802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b0303a99-3379-4f99-9cd2-58c62af75827 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:23.358954 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b0303a99-3379-4f99-9cd2-58c62af75827 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:23.359569 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b0303a99-3379-4f99-9cd2-58c62af75827 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:23.509502 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-fafb26f5-a27b-4462-b6a9-6cabdef1ba63 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:23.520562 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-fafb26f5-a27b-4462-b6a9-6cabdef1ba63 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1319 microversion: 2.1 time: 0.293747 Nov 02 16:48:23.520977 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 173/349] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:23 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:23.566075 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b0303a99-3379-4f99-9cd2-58c62af75827 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:23.574896 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b0303a99-3379-4f99-9cd2-58c62af75827 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1322 microversion: 2.1 time: 0.240776 Nov 02 16:48:23.575541 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 177/350] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:23 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:24.089242 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3e669b11-bff9-41b1-8655-06ab73e66412 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:24.093812 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3e669b11-bff9-41b1-8655-06ab73e66412 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:24.105067 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3e669b11-bff9-41b1-8655-06ab73e66412 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:24.105871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3e669b11-bff9-41b1-8655-06ab73e66412 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:24.111223 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3e669b11-bff9-41b1-8655-06ab73e66412 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:24.111786 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3e669b11-bff9-41b1-8655-06ab73e66412 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:24.153157 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0be08efc-36da-4334-871d-fb5df6832463 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:24.154528 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0be08efc-36da-4334-871d-fb5df6832463 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:24.162033 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0be08efc-36da-4334-871d-fb5df6832463 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:24.163001 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0be08efc-36da-4334-871d-fb5df6832463 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:24.164527 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0be08efc-36da-4334-871d-fb5df6832463 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:24.165238 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0be08efc-36da-4334-871d-fb5df6832463 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:24.300435 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3e669b11-bff9-41b1-8655-06ab73e66412 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28301 microversion: 2.1 time: 0.220654 Nov 02 16:48:24.301400 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 174/351] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:24 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28301 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:24.340050 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-dbbdd169-6575-4c94-ad6f-3743d9c96d47 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:24.341353 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-dbbdd169-6575-4c94-ad6f-3743d9c96d47 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:24.350253 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dbbdd169-6575-4c94-ad6f-3743d9c96d47 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:24.350993 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dbbdd169-6575-4c94-ad6f-3743d9c96d47 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:24.352077 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dbbdd169-6575-4c94-ad6f-3743d9c96d47 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:24.352775 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dbbdd169-6575-4c94-ad6f-3743d9c96d47 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:24.381609 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0be08efc-36da-4334-871d-fb5df6832463 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 27820 microversion: 2.20 time: 0.233421 Nov 02 16:48:24.383579 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 178/352] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:24 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 27820 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:48:24.540007 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-96eb900a-41d2-46fa-9bc3-70281960a734 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:24.540928 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-96eb900a-41d2-46fa-9bc3-70281960a734 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:24.555015 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-96eb900a-41d2-46fa-9bc3-70281960a734 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:24.555484 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-96eb900a-41d2-46fa-9bc3-70281960a734 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:24.559038 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-96eb900a-41d2-46fa-9bc3-70281960a734 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:24.564850 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-96eb900a-41d2-46fa-9bc3-70281960a734 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:24.621246 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-dbbdd169-6575-4c94-ad6f-3743d9c96d47 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:24.644850 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-dbbdd169-6575-4c94-ad6f-3743d9c96d47 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.309013 Nov 02 16:48:24.649578 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 175/353] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:24 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:24.664991 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ddf27c46-7b3a-4f7c-a41a-dc6b0a16eefd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:24.668433 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ddf27c46-7b3a-4f7c-a41a-dc6b0a16eefd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:24.678236 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ddf27c46-7b3a-4f7c-a41a-dc6b0a16eefd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:24.679432 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ddf27c46-7b3a-4f7c-a41a-dc6b0a16eefd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:24.680416 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ddf27c46-7b3a-4f7c-a41a-dc6b0a16eefd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:24.680914 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ddf27c46-7b3a-4f7c-a41a-dc6b0a16eefd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:24.837600 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-96eb900a-41d2-46fa-9bc3-70281960a734 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:24.848111 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-96eb900a-41d2-46fa-9bc3-70281960a734 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1468 microversion: 2.1 time: 0.312496 Nov 02 16:48:24.849124 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 179/354] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:24 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1468 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:24.903918 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5ae958c1-9591-42ae-83e6-f1a88ed73a59 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:24.904684 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5ae958c1-9591-42ae-83e6-f1a88ed73a59 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:24.912812 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ae958c1-9591-42ae-83e6-f1a88ed73a59 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:24.913571 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ae958c1-9591-42ae-83e6-f1a88ed73a59 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:24.916538 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ae958c1-9591-42ae-83e6-f1a88ed73a59 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:24.917233 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ae958c1-9591-42ae-83e6-f1a88ed73a59 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:24.957398 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5ae958c1-9591-42ae-83e6-f1a88ed73a59 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Going to try to terminate instance {{(pid=127649) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:48:25.053581 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ddf27c46-7b3a-4f7c-a41a-dc6b0a16eefd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:25.067644 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ddf27c46-7b3a-4f7c-a41a-dc6b0a16eefd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1322 microversion: 2.1 time: 0.415212 Nov 02 16:48:25.068448 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 176/355] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:24 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:25.111817 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5ae958c1-9591-42ae-83e6-f1a88ed73a59 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "DELETE /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 204 len: 0 microversion: 2.1 time: 0.211452 Nov 02 16:48:25.112476 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 180/356] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:48:24 2021] DELETE /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 16:48:25.125920 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1e9e7735-9816-4ed8-b357-f6f26027dfb0 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:25.126887 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1e9e7735-9816-4ed8-b357-f6f26027dfb0 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:25.137535 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1e9e7735-9816-4ed8-b357-f6f26027dfb0 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:25.138457 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1e9e7735-9816-4ed8-b357-f6f26027dfb0 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:25.139569 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1e9e7735-9816-4ed8-b357-f6f26027dfb0 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:25.140016 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1e9e7735-9816-4ed8-b357-f6f26027dfb0 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:25.314921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-69dc5917-46f6-4097-9e69-f20f550e68de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:25.316809 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-69dc5917-46f6-4097-9e69-f20f550e68de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:25.332906 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-69dc5917-46f6-4097-9e69-f20f550e68de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:25.333400 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-69dc5917-46f6-4097-9e69-f20f550e68de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:25.334339 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-69dc5917-46f6-4097-9e69-f20f550e68de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:25.334806 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-69dc5917-46f6-4097-9e69-f20f550e68de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:25.469737 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1e9e7735-9816-4ed8-b357-f6f26027dfb0 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:25.470400 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-69dc5917-46f6-4097-9e69-f20f550e68de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28301 microversion: 2.1 time: 0.159293 Nov 02 16:48:25.471770 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 181/357] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:25 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28301 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:25.480149 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0b9da741-6928-4a24-a042-c100d5d0da94 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:25.481624 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0b9da741-6928-4a24-a042-c100d5d0da94 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:25.492018 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b9da741-6928-4a24-a042-c100d5d0da94 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:25.492655 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b9da741-6928-4a24-a042-c100d5d0da94 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:25.493826 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b9da741-6928-4a24-a042-c100d5d0da94 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:25.494423 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b9da741-6928-4a24-a042-c100d5d0da94 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:25.503360 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1e9e7735-9816-4ed8-b357-f6f26027dfb0 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1474 microversion: 2.1 time: 0.381691 Nov 02 16:48:25.504644 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 177/358] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:25 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1474 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:25.666807 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6a5a66ab-3037-4538-bb87-94bb603ec0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:25.669209 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6a5a66ab-3037-4538-bb87-94bb603ec0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:25.673385 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0b9da741-6928-4a24-a042-c100d5d0da94 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 27930 microversion: 2.20 time: 0.199029 Nov 02 16:48:25.674620 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 182/359] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:25 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 27930 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:25.682120 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6a5a66ab-3037-4538-bb87-94bb603ec0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:25.682601 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6a5a66ab-3037-4538-bb87-94bb603ec0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:25.683725 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6a5a66ab-3037-4538-bb87-94bb603ec0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:25.684216 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6a5a66ab-3037-4538-bb87-94bb603ec0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:25.849331 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6a5a66ab-3037-4538-bb87-94bb603ec0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:25.857794 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6a5a66ab-3037-4538-bb87-94bb603ec0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.194970 Nov 02 16:48:25.858437 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 178/360] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:25 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:26.086792 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e2d6682f-9366-4daa-8223-525e5d386af2 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:26.090719 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e2d6682f-9366-4daa-8223-525e5d386af2 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:26.100161 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e2d6682f-9366-4daa-8223-525e5d386af2 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:26.100919 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e2d6682f-9366-4daa-8223-525e5d386af2 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:26.101961 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e2d6682f-9366-4daa-8223-525e5d386af2 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:26.102826 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e2d6682f-9366-4daa-8223-525e5d386af2 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:26.307262 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e2d6682f-9366-4daa-8223-525e5d386af2 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:26.316112 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e2d6682f-9366-4daa-8223-525e5d386af2 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1511 microversion: 2.1 time: 0.234304 Nov 02 16:48:26.316983 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 183/361] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:26 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:26.485755 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-de248599-6a39-4599-a5c7-f270561f9d40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:26.491135 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-de248599-6a39-4599-a5c7-f270561f9d40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:26.500069 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-de248599-6a39-4599-a5c7-f270561f9d40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:26.500556 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-de248599-6a39-4599-a5c7-f270561f9d40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:26.501608 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-de248599-6a39-4599-a5c7-f270561f9d40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:26.503193 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-de248599-6a39-4599-a5c7-f270561f9d40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:26.524446 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b06adda8-bc47-44e3-be18-a04a600f86ba tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:26.525608 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b06adda8-bc47-44e3-be18-a04a600f86ba tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:26.535131 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b06adda8-bc47-44e3-be18-a04a600f86ba tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:26.536324 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b06adda8-bc47-44e3-be18-a04a600f86ba tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:26.537494 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b06adda8-bc47-44e3-be18-a04a600f86ba tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:26.538303 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b06adda8-bc47-44e3-be18-a04a600f86ba tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:26.621956 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-de248599-6a39-4599-a5c7-f270561f9d40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28301 microversion: 2.1 time: 0.141464 Nov 02 16:48:26.622875 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 179/362] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:26 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28301 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:26.689389 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3974bf6b-82f8-4169-b0c7-45074986c964 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:26.690953 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3974bf6b-82f8-4169-b0c7-45074986c964 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:26.703058 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3974bf6b-82f8-4169-b0c7-45074986c964 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:26.703538 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3974bf6b-82f8-4169-b0c7-45074986c964 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:26.704409 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3974bf6b-82f8-4169-b0c7-45074986c964 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:26.704865 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3974bf6b-82f8-4169-b0c7-45074986c964 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:26.781030 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b06adda8-bc47-44e3-be18-a04a600f86ba tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:26.790952 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b06adda8-bc47-44e3-be18-a04a600f86ba tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1474 microversion: 2.1 time: 0.271035 Nov 02 16:48:26.791477 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 184/363] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:26 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1474 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:26.878740 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7ae06f8a-2147-4357-9d92-fd1fbedb0046 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:26.879482 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7ae06f8a-2147-4357-9d92-fd1fbedb0046 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:26.888550 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7ae06f8a-2147-4357-9d92-fd1fbedb0046 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:26.889130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7ae06f8a-2147-4357-9d92-fd1fbedb0046 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:26.890129 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7ae06f8a-2147-4357-9d92-fd1fbedb0046 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:26.890808 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7ae06f8a-2147-4357-9d92-fd1fbedb0046 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:27.061619 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7ae06f8a-2147-4357-9d92-fd1fbedb0046 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:27.071706 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7ae06f8a-2147-4357-9d92-fd1fbedb0046 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.199446 Nov 02 16:48:27.072666 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 185/364] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:26 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:27.641288 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2033f596-dfad-4726-91a0-62dd6486151d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:27.642388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2033f596-dfad-4726-91a0-62dd6486151d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:27.653802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2033f596-dfad-4726-91a0-62dd6486151d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:27.654432 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2033f596-dfad-4726-91a0-62dd6486151d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:27.655401 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2033f596-dfad-4726-91a0-62dd6486151d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:27.655933 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2033f596-dfad-4726-91a0-62dd6486151d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:29.693025 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3974bf6b-82f8-4169-b0c7-45074986c964 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28184 microversion: 2.20 time: 3.008417 Nov 02 16:48:29.694719 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 180/365] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:26 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28184 bytes in 3011 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:48:29.701073 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-fbb96549-8ab8-4a10-9aa4-367f703e4c2a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:29.701826 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-fbb96549-8ab8-4a10-9aa4-367f703e4c2a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:29.702362 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2033f596-dfad-4726-91a0-62dd6486151d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28301 microversion: 2.1 time: 2.065988 Nov 02 16:48:29.707640 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 186/366] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:27 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28301 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:29.710300 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c57f495e-4613-4de1-bd29-59feb57cabca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:29.711084 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c57f495e-4613-4de1-bd29-59feb57cabca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:29.712225 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fbb96549-8ab8-4a10-9aa4-367f703e4c2a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:29.712703 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fbb96549-8ab8-4a10-9aa4-367f703e4c2a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:29.713540 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fbb96549-8ab8-4a10-9aa4-367f703e4c2a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:29.714141 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fbb96549-8ab8-4a10-9aa4-367f703e4c2a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:29.719451 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c57f495e-4613-4de1-bd29-59feb57cabca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:29.719915 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c57f495e-4613-4de1-bd29-59feb57cabca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:29.720871 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c57f495e-4613-4de1-bd29-59feb57cabca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:29.721360 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c57f495e-4613-4de1-bd29-59feb57cabca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:29.885795 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c57f495e-4613-4de1-bd29-59feb57cabca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:29.895562 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c57f495e-4613-4de1-bd29-59feb57cabca tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.190090 Nov 02 16:48:29.896577 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-fbb96549-8ab8-4a10-9aa4-367f703e4c2a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:29.896774 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 187/367] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:29 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:29.905265 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-fbb96549-8ab8-4a10-9aa4-367f703e4c2a tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1474 microversion: 2.1 time: 0.209352 Nov 02 16:48:29.906572 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 181/368] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:29 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1474 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:30.707564 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-d72c3210-ecb6-44cf-9ef9-8e2abac6900e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:30.708635 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d72c3210-ecb6-44cf-9ef9-8e2abac6900e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:30.716308 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6a95b626-2f50-4160-a4c3-470fdd11fc90 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:30.716982 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d72c3210-ecb6-44cf-9ef9-8e2abac6900e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:30.716982 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d72c3210-ecb6-44cf-9ef9-8e2abac6900e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:30.717703 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6a95b626-2f50-4160-a4c3-470fdd11fc90 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:30.717862 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d72c3210-ecb6-44cf-9ef9-8e2abac6900e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:30.718180 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d72c3210-ecb6-44cf-9ef9-8e2abac6900e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:30.729262 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6a95b626-2f50-4160-a4c3-470fdd11fc90 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:30.730041 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6a95b626-2f50-4160-a4c3-470fdd11fc90 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:30.730881 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6a95b626-2f50-4160-a4c3-470fdd11fc90 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:30.731381 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6a95b626-2f50-4160-a4c3-470fdd11fc90 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:30.866134 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6a95b626-2f50-4160-a4c3-470fdd11fc90 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28301 microversion: 2.1 time: 0.153749 Nov 02 16:48:30.870925 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-d72c3210-ecb6-44cf-9ef9-8e2abac6900e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28184 microversion: 2.20 time: 0.167339 Nov 02 16:48:30.871663 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 188/369] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:30 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28184 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:30.875381 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 182/370] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:30 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28301 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:30.910062 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6200fc0a-9c52-4be1-bf20-d68ec753d199 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aabec496-3fe2-4609-a6ff-68929d90fc71"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:30.911426 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6200fc0a-9c52-4be1-bf20-d68ec753d199 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:30.914838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-fc86fe0f-7425-421c-8fc3-f17ff7da5365 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:30.915589 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-fc86fe0f-7425-421c-8fc3-f17ff7da5365 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:30.921723 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6200fc0a-9c52-4be1-bf20-d68ec753d199 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:30.922190 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6200fc0a-9c52-4be1-bf20-d68ec753d199 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:30.923399 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6200fc0a-9c52-4be1-bf20-d68ec753d199 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:30.924094 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6200fc0a-9c52-4be1-bf20-d68ec753d199 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:30.924958 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fc86fe0f-7425-421c-8fc3-f17ff7da5365 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:30.925374 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fc86fe0f-7425-421c-8fc3-f17ff7da5365 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:30.926218 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fc86fe0f-7425-421c-8fc3-f17ff7da5365 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:30.926669 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fc86fe0f-7425-421c-8fc3-f17ff7da5365 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:31.221549 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-fc86fe0f-7425-421c-8fc3-f17ff7da5365 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:31.234654 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-fc86fe0f-7425-421c-8fc3-f17ff7da5365 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.324692 Nov 02 16:48:31.235763 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 183/371] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:30 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:31.245872 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-801972de-1c01-44c2-ab88-2cfadac9eea3 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:31.247006 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-801972de-1c01-44c2-ab88-2cfadac9eea3 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:31.259137 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-801972de-1c01-44c2-ab88-2cfadac9eea3 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:31.259800 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-801972de-1c01-44c2-ab88-2cfadac9eea3 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:31.261369 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-801972de-1c01-44c2-ab88-2cfadac9eea3 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:31.261841 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-801972de-1c01-44c2-ab88-2cfadac9eea3 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:31.320777 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6200fc0a-9c52-4be1-bf20-d68ec753d199 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "POST /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417106 Nov 02 16:48:31.322479 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 189/372] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:48:30 2021] POST /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:31.886511 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3bd4869b-13bb-4d62-9494-ff0adffaf3f7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:31.888605 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3bd4869b-13bb-4d62-9494-ff0adffaf3f7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:31.897228 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3bd4869b-13bb-4d62-9494-ff0adffaf3f7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:31.897981 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3bd4869b-13bb-4d62-9494-ff0adffaf3f7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:31.899333 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3bd4869b-13bb-4d62-9494-ff0adffaf3f7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:31.900102 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3bd4869b-13bb-4d62-9494-ff0adffaf3f7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:31.900265 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-801972de-1c01-44c2-ab88-2cfadac9eea3 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:31.916706 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-801972de-1c01-44c2-ab88-2cfadac9eea3 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1474 microversion: 2.1 time: 0.677463 Nov 02 16:48:31.917718 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 184/373] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:31 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1474 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:31.935255 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e77a5482-7fb0-46be-9b77-5a3eea843599 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:31.936484 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e77a5482-7fb0-46be-9b77-5a3eea843599 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:31.944085 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e77a5482-7fb0-46be-9b77-5a3eea843599 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:31.944920 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e77a5482-7fb0-46be-9b77-5a3eea843599 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:31.946003 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e77a5482-7fb0-46be-9b77-5a3eea843599 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:31.947217 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e77a5482-7fb0-46be-9b77-5a3eea843599 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:34.376768 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3bd4869b-13bb-4d62-9494-ff0adffaf3f7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28301 microversion: 2.1 time: 2.497169 Nov 02 16:48:34.378858 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 190/374] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:31 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28301 bytes in 2504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:48:34.388432 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e77a5482-7fb0-46be-9b77-5a3eea843599 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28184 microversion: 2.20 time: 2.468082 Nov 02 16:48:34.389737 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 185/375] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:31 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28184 bytes in 2471 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:34.396938 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ebf814ec-b8ba-4070-b123-9965f4a49b2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:34.398040 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ebf814ec-b8ba-4070-b123-9965f4a49b2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:34.405253 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-f83f4c9e-e44f-4053-9544-109df6a8d3e9 req-b3fd5a7b-52b0-44d7-9bf9-cd1d6be251af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d851b6-e607-4ce6-a1d9-ef7d05efdf08", "name": "network-vif-deleted", "tag": "a7ecf739-9692-469b-a936-8c8d435d6449"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:34.409938 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ebf814ec-b8ba-4070-b123-9965f4a49b2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:34.409938 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ebf814ec-b8ba-4070-b123-9965f4a49b2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:34.411152 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ebf814ec-b8ba-4070-b123-9965f4a49b2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:34.411630 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ebf814ec-b8ba-4070-b123-9965f4a49b2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:34.411941 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:48:34.411941 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:48:34.426684 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-f83f4c9e-e44f-4053-9544-109df6a8d3e9 req-b3fd5a7b-52b0-44d7-9bf9-cd1d6be251af service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:34.427267 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-f83f4c9e-e44f-4053-9544-109df6a8d3e9 req-b3fd5a7b-52b0-44d7-9bf9-cd1d6be251af service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:34.445645 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-f83f4c9e-e44f-4053-9544-109df6a8d3e9 req-b3fd5a7b-52b0-44d7-9bf9-cd1d6be251af service nova] Creating event network-vif-deleted:a7ecf739-9692-469b-a936-8c8d435d6449 for instance 50d851b6-e607-4ce6-a1d9-ef7d05efdf08 on hv-cinder-77387 Nov 02 16:48:34.451767 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-f83f4c9e-e44f-4053-9544-109df6a8d3e9 req-b3fd5a7b-52b0-44d7-9bf9-cd1d6be251af service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070442 Nov 02 16:48:34.452625 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 191/376] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:48:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:34.461187 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-155e0f6e-8384-41d3-a4cd-357cfa1381fc tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:34.461932 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-155e0f6e-8384-41d3-a4cd-357cfa1381fc tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:34.471630 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-155e0f6e-8384-41d3-a4cd-357cfa1381fc tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:34.472267 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-155e0f6e-8384-41d3-a4cd-357cfa1381fc tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:34.473463 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-155e0f6e-8384-41d3-a4cd-357cfa1381fc tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:34.474131 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-155e0f6e-8384-41d3-a4cd-357cfa1381fc tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:34.537629 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-155e0f6e-8384-41d3-a4cd-357cfa1381fc tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:34.538141 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-155e0f6e-8384-41d3-a4cd-357cfa1381fc tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:34.538628 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-155e0f6e-8384-41d3-a4cd-357cfa1381fc tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lazy-loading 'fault' on Instance uuid 50d851b6-e607-4ce6-a1d9-ef7d05efdf08 {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:48:34.586022 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-155e0f6e-8384-41d3-a4cd-357cfa1381fc tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96a35c3d9db45909cc5b37d26e07e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab3a00c690849c1bd017a9733cec34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:34.592948 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ebf814ec-b8ba-4070-b123-9965f4a49b2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:34.596202 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-155e0f6e-8384-41d3-a4cd-357cfa1381fc tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 200 len: 1309 microversion: 2.1 time: 0.141013 Nov 02 16:48:34.597778 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 192/377] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:34 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 1309 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:34.603763 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ebf814ec-b8ba-4070-b123-9965f4a49b2f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.212018 Nov 02 16:48:34.604458 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 186/378] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:34 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:35.391824 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-01269878-bafe-4506-b2ee-e15a0e9311b7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:35.393055 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-01269878-bafe-4506-b2ee-e15a0e9311b7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:35.404604 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-01269878-bafe-4506-b2ee-e15a0e9311b7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:35.405436 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-01269878-bafe-4506-b2ee-e15a0e9311b7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:35.406499 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-01269878-bafe-4506-b2ee-e15a0e9311b7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:35.407047 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-21d154d3-79dc-4e58-8d13-fe1dd63e9b55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:35.407707 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-01269878-bafe-4506-b2ee-e15a0e9311b7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:35.408207 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-21d154d3-79dc-4e58-8d13-fe1dd63e9b55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:35.416317 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-21d154d3-79dc-4e58-8d13-fe1dd63e9b55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:35.416795 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-21d154d3-79dc-4e58-8d13-fe1dd63e9b55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:35.425667 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-21d154d3-79dc-4e58-8d13-fe1dd63e9b55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:35.425667 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-21d154d3-79dc-4e58-8d13-fe1dd63e9b55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:35.535846 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-01269878-bafe-4506-b2ee-e15a0e9311b7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28441 microversion: 2.1 time: 0.147620 Nov 02 16:48:35.544277 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-21d154d3-79dc-4e58-8d13-fe1dd63e9b55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28184 microversion: 2.20 time: 0.137775 Nov 02 16:48:35.545943 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 187/379] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:35 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28184 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:35.547136 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 193/380] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:35 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28441 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:35.617275 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3ffbf596-d732-456d-aa48-b34a49a27997 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:35.618023 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3ffbf596-d732-456d-aa48-b34a49a27997 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] [instance: 50d851b6-e607-4ce6-a1d9-ef7d05efdf08] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:35.622359 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-921a5a50-0d7c-4b54-980d-cc41df36851a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:35.623130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-921a5a50-0d7c-4b54-980d-cc41df36851a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:35.626608 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3ffbf596-d732-456d-aa48-b34a49a27997 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:35.627085 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3ffbf596-d732-456d-aa48-b34a49a27997 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:35.628425 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3ffbf596-d732-456d-aa48-b34a49a27997 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:35.628563 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3ffbf596-d732-456d-aa48-b34a49a27997 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:35.632021 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-921a5a50-0d7c-4b54-980d-cc41df36851a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:35.632582 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-921a5a50-0d7c-4b54-980d-cc41df36851a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:35.633419 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-921a5a50-0d7c-4b54-980d-cc41df36851a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:35.633963 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-921a5a50-0d7c-4b54-980d-cc41df36851a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:35.646520 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-3ffbf596-d732-456d-aa48-b34a49a27997 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] HTTP exception thrown: Instance 50d851b6-e607-4ce6-a1d9-ef7d05efdf08 could not be found. Nov 02 16:48:35.647181 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3ffbf596-d732-456d-aa48-b34a49a27997 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] Returning 404 to user: Instance 50d851b6-e607-4ce6-a1d9-ef7d05efdf08 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:48:35.648084 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3ffbf596-d732-456d-aa48-b34a49a27997 tempest-VolumesNegativeTest-1150497647 tempest-VolumesNegativeTest-1150497647-project] 10.222.0.118 "GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08" status: 404 len: 111 microversion: 2.1 time: 0.036448 Nov 02 16:48:35.652690 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 188/381] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:35 2021] GET /compute/v2.1/servers/50d851b6-e607-4ce6-a1d9-ef7d05efdf08 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:48:35.831403 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-921a5a50-0d7c-4b54-980d-cc41df36851a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:35.842320 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-921a5a50-0d7c-4b54-980d-cc41df36851a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.224458 Nov 02 16:48:35.842978 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 194/382] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:35 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:36.554172 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-605e1dc1-d979-4f19-9b16-f5d43080702d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:36.555020 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b612cbcf-13b2-493e-9a8e-f1a07b0a8881 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:36.555712 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b612cbcf-13b2-493e-9a8e-f1a07b0a8881 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:36.555845 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-605e1dc1-d979-4f19-9b16-f5d43080702d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:36.563537 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b612cbcf-13b2-493e-9a8e-f1a07b0a8881 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:36.564272 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b612cbcf-13b2-493e-9a8e-f1a07b0a8881 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:36.565393 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b612cbcf-13b2-493e-9a8e-f1a07b0a8881 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:36.566022 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b612cbcf-13b2-493e-9a8e-f1a07b0a8881 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:36.567082 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-605e1dc1-d979-4f19-9b16-f5d43080702d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:36.568357 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-605e1dc1-d979-4f19-9b16-f5d43080702d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:36.569335 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-605e1dc1-d979-4f19-9b16-f5d43080702d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:36.569952 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-605e1dc1-d979-4f19-9b16-f5d43080702d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:36.664423 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b612cbcf-13b2-493e-9a8e-f1a07b0a8881 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28184 microversion: 2.20 time: 0.115067 Nov 02 16:48:36.665520 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 195/383] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:36 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28184 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:36.725063 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-605e1dc1-d979-4f19-9b16-f5d43080702d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28589 microversion: 2.1 time: 0.167947 Nov 02 16:48:36.726003 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 189/384] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:36 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28589 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:36.861275 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9446a616-e2ef-476c-85fe-6267eade1b90 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:36.862349 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9446a616-e2ef-476c-85fe-6267eade1b90 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:36.870450 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9446a616-e2ef-476c-85fe-6267eade1b90 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:36.870920 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9446a616-e2ef-476c-85fe-6267eade1b90 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:36.871750 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9446a616-e2ef-476c-85fe-6267eade1b90 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:36.872208 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9446a616-e2ef-476c-85fe-6267eade1b90 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:37.067195 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-9446a616-e2ef-476c-85fe-6267eade1b90 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:37.078254 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9446a616-e2ef-476c-85fe-6267eade1b90 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.221439 Nov 02 16:48:37.079422 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 196/385] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:36 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:37.682901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-40e40881-ae84-4658-9ecb-030669d9dec2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:37.684420 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-40e40881-ae84-4658-9ecb-030669d9dec2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:37.701025 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-40e40881-ae84-4658-9ecb-030669d9dec2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:37.702319 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-40e40881-ae84-4658-9ecb-030669d9dec2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:37.704084 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-40e40881-ae84-4658-9ecb-030669d9dec2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:37.705793 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-40e40881-ae84-4658-9ecb-030669d9dec2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:37.754315 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ebe0dc29-0230-4b0b-9038-e8e6c8359bd0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:37.755789 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ebe0dc29-0230-4b0b-9038-e8e6c8359bd0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:37.782920 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ebe0dc29-0230-4b0b-9038-e8e6c8359bd0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:37.783613 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ebe0dc29-0230-4b0b-9038-e8e6c8359bd0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:37.784706 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ebe0dc29-0230-4b0b-9038-e8e6c8359bd0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:37.788536 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ebe0dc29-0230-4b0b-9038-e8e6c8359bd0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:39.765539 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-40e40881-ae84-4658-9ecb-030669d9dec2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28184 microversion: 2.20 time: 2.089993 Nov 02 16:48:39.769245 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 190/386] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:37 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28184 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:39.773467 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-922539b5-87d6-4da9-9756-d77f6c9d5f21 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:39.774121 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-922539b5-87d6-4da9-9756-d77f6c9d5f21 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:39.783321 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-922539b5-87d6-4da9-9756-d77f6c9d5f21 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:39.783718 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-922539b5-87d6-4da9-9756-d77f6c9d5f21 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:39.784481 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-922539b5-87d6-4da9-9756-d77f6c9d5f21 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:39.784928 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-922539b5-87d6-4da9-9756-d77f6c9d5f21 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:39.797651 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ebe0dc29-0230-4b0b-9038-e8e6c8359bd0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28589 microversion: 2.1 time: 2.049786 Nov 02 16:48:39.798486 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 197/387] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:37 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28589 bytes in 2052 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:39.971099 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-922539b5-87d6-4da9-9756-d77f6c9d5f21 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:39.982143 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-922539b5-87d6-4da9-9756-d77f6c9d5f21 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1525 microversion: 2.1 time: 0.212962 Nov 02 16:48:39.983179 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 191/388] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:39 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1525 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:40.781132 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9bcf981f-e042-4121-9b63-fcbc3e35d317 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:40.782974 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9bcf981f-e042-4121-9b63-fcbc3e35d317 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:40.794320 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bcf981f-e042-4121-9b63-fcbc3e35d317 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:40.795013 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bcf981f-e042-4121-9b63-fcbc3e35d317 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:40.796031 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bcf981f-e042-4121-9b63-fcbc3e35d317 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:40.796602 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bcf981f-e042-4121-9b63-fcbc3e35d317 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:40.814858 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e1fe8a39-70ff-4f5e-b845-ad0616a482ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:40.816433 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e1fe8a39-70ff-4f5e-b845-ad0616a482ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:40.826680 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e1fe8a39-70ff-4f5e-b845-ad0616a482ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:40.826680 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e1fe8a39-70ff-4f5e-b845-ad0616a482ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:40.827104 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e1fe8a39-70ff-4f5e-b845-ad0616a482ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:40.827358 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e1fe8a39-70ff-4f5e-b845-ad0616a482ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:40.971961 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e1fe8a39-70ff-4f5e-b845-ad0616a482ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28757 microversion: 2.1 time: 0.163004 Nov 02 16:48:40.973447 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 192/389] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:40 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:40.999719 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9bcf981f-e042-4121-9b63-fcbc3e35d317 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28392 microversion: 2.20 time: 0.223823 Nov 02 16:48:41.000637 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 198/390] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:40 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28392 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:41.006554 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-513d5e31-842a-492b-a8d1-3135ea417b63 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:41.007726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-513d5e31-842a-492b-a8d1-3135ea417b63 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:41.017011 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-513d5e31-842a-492b-a8d1-3135ea417b63 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:41.018651 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-513d5e31-842a-492b-a8d1-3135ea417b63 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:41.019711 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-513d5e31-842a-492b-a8d1-3135ea417b63 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:41.020424 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-513d5e31-842a-492b-a8d1-3135ea417b63 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:41.218398 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-513d5e31-842a-492b-a8d1-3135ea417b63 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:41.229092 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-513d5e31-842a-492b-a8d1-3135ea417b63 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1505 microversion: 2.1 time: 0.229787 Nov 02 16:48:41.230336 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 193/391] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:40 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:41.294869 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2024eeb2-f4c7-4ad3-9dcb-a07eab1f91e1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:41.295976 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2024eeb2-f4c7-4ad3-9dcb-a07eab1f91e1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:41.304796 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2024eeb2-f4c7-4ad3-9dcb-a07eab1f91e1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:41.305270 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2024eeb2-f4c7-4ad3-9dcb-a07eab1f91e1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:41.306109 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2024eeb2-f4c7-4ad3-9dcb-a07eab1f91e1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:41.307090 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2024eeb2-f4c7-4ad3-9dcb-a07eab1f91e1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:41.482800 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2024eeb2-f4c7-4ad3-9dcb-a07eab1f91e1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:41.494215 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2024eeb2-f4c7-4ad3-9dcb-a07eab1f91e1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1519 microversion: 2.1 time: 0.204021 Nov 02 16:48:41.495587 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 199/392] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:41 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:41.996316 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-390247b8-00d0-4bca-8537-0795b38fa3ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:42.000099 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-390247b8-00d0-4bca-8537-0795b38fa3ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:42.017341 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6c9dd375-977b-4ec9-9f6a-a4bd86b72f46 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:42.025444 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6c9dd375-977b-4ec9-9f6a-a4bd86b72f46 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:42.034217 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-390247b8-00d0-4bca-8537-0795b38fa3ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:42.036585 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-390247b8-00d0-4bca-8537-0795b38fa3ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:42.043052 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-390247b8-00d0-4bca-8537-0795b38fa3ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:42.044813 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-390247b8-00d0-4bca-8537-0795b38fa3ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:42.049958 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6c9dd375-977b-4ec9-9f6a-a4bd86b72f46 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:42.050296 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6c9dd375-977b-4ec9-9f6a-a4bd86b72f46 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:42.051141 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6c9dd375-977b-4ec9-9f6a-a4bd86b72f46 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:42.056948 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6c9dd375-977b-4ec9-9f6a-a4bd86b72f46 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:42.184630 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6c9dd375-977b-4ec9-9f6a-a4bd86b72f46 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28472 microversion: 2.20 time: 0.175013 Nov 02 16:48:42.197502 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 200/393] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:42 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:42.198201 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-390247b8-00d0-4bca-8537-0795b38fa3ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28757 microversion: 2.1 time: 0.213835 Nov 02 16:48:42.198931 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 194/394] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:41 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28757 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:43.046042 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-786b121a-b295-43ca-8cb0-d83486b27b77 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:43.047031 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-786b121a-b295-43ca-8cb0-d83486b27b77 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:43.054859 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-786b121a-b295-43ca-8cb0-d83486b27b77 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:43.055322 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-786b121a-b295-43ca-8cb0-d83486b27b77 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:43.056147 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-786b121a-b295-43ca-8cb0-d83486b27b77 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:43.056625 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-786b121a-b295-43ca-8cb0-d83486b27b77 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:43.083029 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-786b121a-b295-43ca-8cb0-d83486b27b77 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lazy-loading 'flavor' on Instance uuid 6e5b406e-d37d-44b0-bb2f-39532baf3f9e {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:48:43.208072 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-786b121a-b295-43ca-8cb0-d83486b27b77 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "POST /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/action" status: 200 len: 32 microversion: 2.1 time: 0.166541 Nov 02 16:48:43.213393 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 201/395] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:43 2021] POST /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:48:43.213593 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0a54255a-6423-44f5-afe4-96ef172066ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:43.213593 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0a54255a-6423-44f5-afe4-96ef172066ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:43.217777 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a8b14692-d80f-44e8-af66-afeec468e58e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:43.219036 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a8b14692-d80f-44e8-af66-afeec468e58e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:43.224860 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0a54255a-6423-44f5-afe4-96ef172066ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:43.225424 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0a54255a-6423-44f5-afe4-96ef172066ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:43.226628 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0a54255a-6423-44f5-afe4-96ef172066ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:43.227162 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0a54255a-6423-44f5-afe4-96ef172066ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:43.231381 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a8b14692-d80f-44e8-af66-afeec468e58e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:43.231381 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a8b14692-d80f-44e8-af66-afeec468e58e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:43.232282 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a8b14692-d80f-44e8-af66-afeec468e58e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:43.232833 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a8b14692-d80f-44e8-af66-afeec468e58e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:46.017073 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0a54255a-6423-44f5-afe4-96ef172066ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28472 microversion: 2.20 time: 2.819345 Nov 02 16:48:46.019281 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 195/396] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:43 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28472 bytes in 2824 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:46.023857 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a8b14692-d80f-44e8-af66-afeec468e58e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28757 microversion: 2.1 time: 2.811462 Nov 02 16:48:46.028208 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9230cbcd-704f-48c1-9cae-fc714281df06 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:46.028955 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9230cbcd-704f-48c1-9cae-fc714281df06 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:46.029619 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 202/397] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:43 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28757 bytes in 2820 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:46.037071 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e8451aaf-67e6-4c29-8196-e1c6c6411a2e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aabec496-3fe2-4609-a6ff-68929d90fc71"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:46.038325 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e8451aaf-67e6-4c29-8196-e1c6c6411a2e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:46.041573 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9230cbcd-704f-48c1-9cae-fc714281df06 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:46.042110 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9230cbcd-704f-48c1-9cae-fc714281df06 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:46.043442 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9230cbcd-704f-48c1-9cae-fc714281df06 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:46.044118 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9230cbcd-704f-48c1-9cae-fc714281df06 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:46.047574 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e8451aaf-67e6-4c29-8196-e1c6c6411a2e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:46.049001 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e8451aaf-67e6-4c29-8196-e1c6c6411a2e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:46.050489 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e8451aaf-67e6-4c29-8196-e1c6c6411a2e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:46.051146 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e8451aaf-67e6-4c29-8196-e1c6c6411a2e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:46.156242 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-e8451aaf-67e6-4c29-8196-e1c6c6411a2e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] HTTP exception thrown: Invalid volume: volume aabec496-3fe2-4609-a6ff-68929d90fc71 is already attached to instances: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 Nov 02 16:48:46.157369 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e8451aaf-67e6-4c29-8196-e1c6c6411a2e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Returning 400 to user: Invalid volume: volume aabec496-3fe2-4609-a6ff-68929d90fc71 is already attached to instances: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:48:46.159253 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e8451aaf-67e6-4c29-8196-e1c6c6411a2e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "POST /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127978 Nov 02 16:48:46.164239 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 203/398] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:48:46 2021] POST /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments => generated 174 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 16:48:46.231426 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f4d9adf4-1334-4b44-b623-dbe496de4b28 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:46.231937 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f4d9adf4-1334-4b44-b623-dbe496de4b28 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:46.241348 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f4d9adf4-1334-4b44-b623-dbe496de4b28 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:46.241810 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f4d9adf4-1334-4b44-b623-dbe496de4b28 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:46.242899 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f4d9adf4-1334-4b44-b623-dbe496de4b28 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:46.243772 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f4d9adf4-1334-4b44-b623-dbe496de4b28 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:46.366329 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9230cbcd-704f-48c1-9cae-fc714281df06 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:46.377390 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9230cbcd-704f-48c1-9cae-fc714281df06 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.353692 Nov 02 16:48:46.378416 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 196/399] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:46 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:46.409329 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-f4d9adf4-1334-4b44-b623-dbe496de4b28 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lazy-loading 'services' on Instance uuid fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:48:46.554041 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f4d9adf4-1334-4b44-b623-dbe496de4b28 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "DELETE /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments/aabec496-3fe2-4609-a6ff-68929d90fc71" status: 202 len: 0 microversion: 2.1 time: 0.326356 Nov 02 16:48:46.554801 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 204/400] 10.222.0.118 () {58 vars in 1420 bytes} [Tue Nov 2 16:48:46 2021] DELETE /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments/aabec496-3fe2-4609-a6ff-68929d90fc71 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:48:46.564837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5783e199-186d-4ead-8891-f429286ed54b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:46.566062 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5783e199-186d-4ead-8891-f429286ed54b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:46.572906 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5783e199-186d-4ead-8891-f429286ed54b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:46.573525 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5783e199-186d-4ead-8891-f429286ed54b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:46.577623 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5783e199-186d-4ead-8891-f429286ed54b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:46.578264 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5783e199-186d-4ead-8891-f429286ed54b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:46.624978 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5783e199-186d-4ead-8891-f429286ed54b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064779 Nov 02 16:48:46.628347 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 197/401] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:48:46 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:47.032675 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e2716f40-514c-44e3-95c1-73b0a6606dee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:47.034603 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e2716f40-514c-44e3-95c1-73b0a6606dee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:47.037676 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-aa864e48-33d3-454c-86ad-e377af96c7bf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:47.038706 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-aa864e48-33d3-454c-86ad-e377af96c7bf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:47.041832 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e2716f40-514c-44e3-95c1-73b0a6606dee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:47.042299 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e2716f40-514c-44e3-95c1-73b0a6606dee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:47.043129 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e2716f40-514c-44e3-95c1-73b0a6606dee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:47.043574 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e2716f40-514c-44e3-95c1-73b0a6606dee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:47.045719 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aa864e48-33d3-454c-86ad-e377af96c7bf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:47.046210 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aa864e48-33d3-454c-86ad-e377af96c7bf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:47.047021 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aa864e48-33d3-454c-86ad-e377af96c7bf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:47.047483 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aa864e48-33d3-454c-86ad-e377af96c7bf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:47.182210 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e2716f40-514c-44e3-95c1-73b0a6606dee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28638 microversion: 2.20 time: 0.154373 Nov 02 16:48:47.183152 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 205/402] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:47 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28638 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:47.189067 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-aa864e48-33d3-454c-86ad-e377af96c7bf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28757 microversion: 2.1 time: 0.156000 Nov 02 16:48:47.194466 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 198/403] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:47 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:48:47.398116 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c8a884e0-e80e-4f15-8147-5e3c42ea9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:47.399608 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c8a884e0-e80e-4f15-8147-5e3c42ea9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:47.408115 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c8a884e0-e80e-4f15-8147-5e3c42ea9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:47.408945 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c8a884e0-e80e-4f15-8147-5e3c42ea9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:47.409797 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c8a884e0-e80e-4f15-8147-5e3c42ea9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:47.410244 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c8a884e0-e80e-4f15-8147-5e3c42ea9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:47.571877 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c8a884e0-e80e-4f15-8147-5e3c42ea9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:47.580731 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c8a884e0-e80e-4f15-8147-5e3c42ea9323 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.187667 Nov 02 16:48:47.581897 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 206/404] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:47 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:48:47.644362 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0148218d-f2bd-46d0-8a24-78ad10212c92 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:47.644362 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0148218d-f2bd-46d0-8a24-78ad10212c92 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:47.650722 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0148218d-f2bd-46d0-8a24-78ad10212c92 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:47.651195 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0148218d-f2bd-46d0-8a24-78ad10212c92 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:47.652437 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0148218d-f2bd-46d0-8a24-78ad10212c92 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:47.652578 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0148218d-f2bd-46d0-8a24-78ad10212c92 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:47.693191 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0148218d-f2bd-46d0-8a24-78ad10212c92 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057333 Nov 02 16:48:47.693834 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 199/405] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:48:47 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:48.196284 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b7190985-5fcd-4ca9-a633-20ae85321ce0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:48.197392 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b7190985-5fcd-4ca9-a633-20ae85321ce0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:48.202916 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a26cb81b-2127-4d3f-920b-99c93009afd8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:48.203903 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a26cb81b-2127-4d3f-920b-99c93009afd8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:48.204304 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7190985-5fcd-4ca9-a633-20ae85321ce0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:48.204832 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7190985-5fcd-4ca9-a633-20ae85321ce0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:48.206403 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7190985-5fcd-4ca9-a633-20ae85321ce0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:48.207042 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7190985-5fcd-4ca9-a633-20ae85321ce0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:48.213979 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a26cb81b-2127-4d3f-920b-99c93009afd8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:48.214537 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a26cb81b-2127-4d3f-920b-99c93009afd8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:48.215603 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a26cb81b-2127-4d3f-920b-99c93009afd8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:48.216389 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a26cb81b-2127-4d3f-920b-99c93009afd8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:50.475664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b7190985-5fcd-4ca9-a633-20ae85321ce0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28638 microversion: 2.20 time: 2.283304 Nov 02 16:48:50.476584 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 207/406] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:48 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28638 bytes in 2285 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:50.484478 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4d9b4f59-fa28-4dfc-967d-a5d86944d9d8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:50.485626 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4d9b4f59-fa28-4dfc-967d-a5d86944d9d8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:50.493559 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4d9b4f59-fa28-4dfc-967d-a5d86944d9d8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:50.494475 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4d9b4f59-fa28-4dfc-967d-a5d86944d9d8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:50.495607 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4d9b4f59-fa28-4dfc-967d-a5d86944d9d8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:50.496347 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4d9b4f59-fa28-4dfc-967d-a5d86944d9d8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:50.561547 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a26cb81b-2127-4d3f-920b-99c93009afd8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28757 microversion: 2.1 time: 2.362565 Nov 02 16:48:50.563163 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 200/407] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:48 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28757 bytes in 2365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:50.574043 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-665a3b29-b0a6-4d9a-9b52-75873214834d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:50.586481 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-665a3b29-b0a6-4d9a-9b52-75873214834d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:50.605888 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-665a3b29-b0a6-4d9a-9b52-75873214834d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:50.606781 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-665a3b29-b0a6-4d9a-9b52-75873214834d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:50.607844 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-665a3b29-b0a6-4d9a-9b52-75873214834d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:50.608714 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-665a3b29-b0a6-4d9a-9b52-75873214834d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:50.662217 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-665a3b29-b0a6-4d9a-9b52-75873214834d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092526 Nov 02 16:48:50.662794 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 201/408] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:48:50 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:50.739056 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-4d9b4f59-fa28-4dfc-967d-a5d86944d9d8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:50.752105 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4d9b4f59-fa28-4dfc-967d-a5d86944d9d8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.273274 Nov 02 16:48:50.753692 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 208/409] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:50 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:51.488066 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6acd8f3f-48d3-44d8-846c-73b6abea4399 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:51.489148 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6acd8f3f-48d3-44d8-846c-73b6abea4399 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:51.496966 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6acd8f3f-48d3-44d8-846c-73b6abea4399 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:51.497438 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6acd8f3f-48d3-44d8-846c-73b6abea4399 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:51.498360 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6acd8f3f-48d3-44d8-846c-73b6abea4399 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:51.498841 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6acd8f3f-48d3-44d8-846c-73b6abea4399 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:51.576219 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9d45c9cb-6682-4d1d-bb17-d873f71df9b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:51.577061 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9d45c9cb-6682-4d1d-bb17-d873f71df9b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:51.585514 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9d45c9cb-6682-4d1d-bb17-d873f71df9b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:51.585974 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9d45c9cb-6682-4d1d-bb17-d873f71df9b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:51.586799 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9d45c9cb-6682-4d1d-bb17-d873f71df9b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:51.587252 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9d45c9cb-6682-4d1d-bb17-d873f71df9b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:54.056884 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6acd8f3f-48d3-44d8-846c-73b6abea4399 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28638 microversion: 2.20 time: 2.572785 Nov 02 16:48:54.059184 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 202/410] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:51 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28638 bytes in 2576 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:54.068352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9d45c9cb-6682-4d1d-bb17-d873f71df9b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28757 microversion: 2.1 time: 2.495464 Nov 02 16:48:54.070710 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 209/411] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:51 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28757 bytes in 2500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:54.082681 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-89edc486-0b64-410b-8820-c0291b5a3aa1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:54.085086 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ac8fac4e-de1f-49e2-83ac-a472e81c92eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:54.086404 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-89edc486-0b64-410b-8820-c0291b5a3aa1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:54.087998 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ac8fac4e-de1f-49e2-83ac-a472e81c92eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:54.107443 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-89edc486-0b64-410b-8820-c0291b5a3aa1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:54.107997 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-89edc486-0b64-410b-8820-c0291b5a3aa1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:54.108798 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-89edc486-0b64-410b-8820-c0291b5a3aa1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:54.109406 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-89edc486-0b64-410b-8820-c0291b5a3aa1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:54.113061 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ac8fac4e-de1f-49e2-83ac-a472e81c92eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:54.113736 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ac8fac4e-de1f-49e2-83ac-a472e81c92eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:54.114623 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ac8fac4e-de1f-49e2-83ac-a472e81c92eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:54.115080 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ac8fac4e-de1f-49e2-83ac-a472e81c92eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:54.188363 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ac8fac4e-de1f-49e2-83ac-a472e81c92eb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126830 Nov 02 16:48:54.190867 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 203/412] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:48:54 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:48:54.380062 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-89edc486-0b64-410b-8820-c0291b5a3aa1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:54.395833 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-89edc486-0b64-410b-8820-c0291b5a3aa1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.323350 Nov 02 16:48:54.397157 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 210/413] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:54 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:55.073351 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9e8684f8-390e-4ab0-9cd9-d0e5a39b61cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:55.074268 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9e8684f8-390e-4ab0-9cd9-d0e5a39b61cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:55.083350 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b90aefb7-2f4d-41ce-a7ee-af86e5c3087e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:55.084383 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b90aefb7-2f4d-41ce-a7ee-af86e5c3087e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:55.097115 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b90aefb7-2f4d-41ce-a7ee-af86e5c3087e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:55.099427 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e8684f8-390e-4ab0-9cd9-d0e5a39b61cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:55.099885 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e8684f8-390e-4ab0-9cd9-d0e5a39b61cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:55.100765 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e8684f8-390e-4ab0-9cd9-d0e5a39b61cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:55.101201 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e8684f8-390e-4ab0-9cd9-d0e5a39b61cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:55.102326 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b90aefb7-2f4d-41ce-a7ee-af86e5c3087e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:55.103083 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b90aefb7-2f4d-41ce-a7ee-af86e5c3087e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:55.103526 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b90aefb7-2f4d-41ce-a7ee-af86e5c3087e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:55.210827 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9e8684f8-390e-4ab0-9cd9-d0e5a39b61cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28638 microversion: 2.20 time: 0.142783 Nov 02 16:48:55.215320 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 204/414] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:55 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28638 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:55.217355 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a70c3739-705c-4bbd-9071-8a2e54bfa238 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:55.218464 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a70c3739-705c-4bbd-9071-8a2e54bfa238 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:55.224049 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b90aefb7-2f4d-41ce-a7ee-af86e5c3087e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28757 microversion: 2.1 time: 0.143077 Nov 02 16:48:55.225273 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 211/415] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:55 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28757 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:48:55.235391 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a70c3739-705c-4bbd-9071-8a2e54bfa238 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:55.235984 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a70c3739-705c-4bbd-9071-8a2e54bfa238 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:55.236882 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a70c3739-705c-4bbd-9071-8a2e54bfa238 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:55.237534 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a70c3739-705c-4bbd-9071-8a2e54bfa238 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:55.286213 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a70c3739-705c-4bbd-9071-8a2e54bfa238 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073237 Nov 02 16:48:55.287688 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 205/416] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:48:55 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:48:55.426404 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b71e55a0-fd57-4c00-a5b1-076da6957952 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:55.427352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b71e55a0-fd57-4c00-a5b1-076da6957952 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:55.448479 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b71e55a0-fd57-4c00-a5b1-076da6957952 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:55.462339 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b71e55a0-fd57-4c00-a5b1-076da6957952 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:55.467533 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b71e55a0-fd57-4c00-a5b1-076da6957952 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:55.468126 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b71e55a0-fd57-4c00-a5b1-076da6957952 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:55.686199 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1039063851", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "networks": [{"uuid": "716d1add-eeb0-4090-99a3-8e93ac4c3a42"}]}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:55.778255 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.network.neutron [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] validate_networks() for [('716d1add-eeb0-4090-99a3-8e93ac4c3a42', None, None, None, None, None)] {{(pid=127648) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:48:55.864808 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b71e55a0-fd57-4c00-a5b1-076da6957952 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:55.878709 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b71e55a0-fd57-4c00-a5b1-076da6957952 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.457467 Nov 02 16:48:55.889786 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 212/417] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:55 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:56.224207 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6047ffc6-a66a-407d-a62c-e66e727084ff tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:56.226219 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6047ffc6-a66a-407d-a62c-e66e727084ff tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:56.250388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6047ffc6-a66a-407d-a62c-e66e727084ff tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:56.250388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6047ffc6-a66a-407d-a62c-e66e727084ff tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:56.251019 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6047ffc6-a66a-407d-a62c-e66e727084ff tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:56.251498 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6047ffc6-a66a-407d-a62c-e66e727084ff tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:56.351748 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6047ffc6-a66a-407d-a62c-e66e727084ff tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28638 microversion: 2.20 time: 0.132740 Nov 02 16:48:56.354055 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 213/418] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:56 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28638 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:56.362856 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-26b32bde-2dae-450d-a161-4f1c64b669c3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:56.364843 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-26b32bde-2dae-450d-a161-4f1c64b669c3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:56.373328 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-26b32bde-2dae-450d-a161-4f1c64b669c3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:56.374453 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-26b32bde-2dae-450d-a161-4f1c64b669c3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:56.375464 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-26b32bde-2dae-450d-a161-4f1c64b669c3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:56.376015 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-26b32bde-2dae-450d-a161-4f1c64b669c3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:56.475127 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-26b32bde-2dae-450d-a161-4f1c64b669c3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28757 microversion: 2.1 time: 0.118631 Nov 02 16:48:56.477941 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 214/419] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:56 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28757 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:48:56.670695 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Flavor limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:48:56.671406 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Image limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:48:56.671762 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Flavor pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:48:56.672239 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Image pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:48:56.672747 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:48:56.729131 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:56.729604 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:56.730467 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:56.730917 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:56.821233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Getting quotas for project fd124bfe873f4553b53c6d8282df462c. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:48:56.852116 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Getting quotas for user 3f09374d85e441bea89376debca253d9 and project fd124bfe873f4553b53c6d8282df462c. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:48:56.907400 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-eb49771f-b751-436b-8d87-94175eac4c1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:56.912130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-eb49771f-b751-436b-8d87-94175eac4c1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:56.937246 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Going to run 1 instances... {{(pid=127648) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:48:56.941995 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-eb49771f-b751-436b-8d87-94175eac4c1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:56.942447 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-eb49771f-b751-436b-8d87-94175eac4c1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:56.945681 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:48:56.946958 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-eb49771f-b751-436b-8d87-94175eac4c1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:56.949507 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-eb49771f-b751-436b-8d87-94175eac4c1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:57.105921 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-007d3f6c-f389-4704-9868-df5da2f7b76b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.421984 Nov 02 16:48:57.116544 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 206/420] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:48:55 2021] POST /compute/v2.1/servers => generated 382 bytes in 1435 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:48:57.122082 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-057cb863-668e-4cbd-aa6e-98668b061bff tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:57.138101 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-057cb863-668e-4cbd-aa6e-98668b061bff tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:57.272023 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-057cb863-668e-4cbd-aa6e-98668b061bff tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:57.284649 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-057cb863-668e-4cbd-aa6e-98668b061bff tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1222 microversion: 2.1 time: 0.166443 Nov 02 16:48:57.286235 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 207/421] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:57 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1222 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:57.369948 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2694bd6e-d6a7-462b-842b-92dbb732f6fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:57.371822 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2694bd6e-d6a7-462b-842b-92dbb732f6fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:57.387345 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2694bd6e-d6a7-462b-842b-92dbb732f6fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:57.389544 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2694bd6e-d6a7-462b-842b-92dbb732f6fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:57.392852 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2694bd6e-d6a7-462b-842b-92dbb732f6fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:57.396228 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2694bd6e-d6a7-462b-842b-92dbb732f6fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:57.426375 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-eb49771f-b751-436b-8d87-94175eac4c1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:57.450879 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-eb49771f-b751-436b-8d87-94175eac4c1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.552313 Nov 02 16:48:57.451574 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 215/422] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:56 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:57.491947 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ba15e9fd-fe39-400b-950d-083af7dbcf8e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:57.493434 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ba15e9fd-fe39-400b-950d-083af7dbcf8e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:57.518544 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ba15e9fd-fe39-400b-950d-083af7dbcf8e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:57.526674 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ba15e9fd-fe39-400b-950d-083af7dbcf8e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:57.536674 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ba15e9fd-fe39-400b-950d-083af7dbcf8e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:57.537809 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ba15e9fd-fe39-400b-950d-083af7dbcf8e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:57.579136 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2694bd6e-d6a7-462b-842b-92dbb732f6fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28638 microversion: 2.20 time: 0.214746 Nov 02 16:48:57.580154 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 208/423] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:57 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28638 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:48:57.717265 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ba15e9fd-fe39-400b-950d-083af7dbcf8e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28757 microversion: 2.1 time: 0.229755 Nov 02 16:48:57.718419 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 216/424] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:57 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28757 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:48:58.325233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7bcc3fa5-04c1-4c20-ab0b-65e64d650359 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:58.326005 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7bcc3fa5-04c1-4c20-ab0b-65e64d650359 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:58.375879 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7bcc3fa5-04c1-4c20-ab0b-65e64d650359 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:58.395548 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7bcc3fa5-04c1-4c20-ab0b-65e64d650359 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:58.396614 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7bcc3fa5-04c1-4c20-ab0b-65e64d650359 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:58.397132 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7bcc3fa5-04c1-4c20-ab0b-65e64d650359 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:58.473040 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-aedf3784-3b97-4361-96b7-49bab4ae6dfa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:48:58.473777 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-aedf3784-3b97-4361-96b7-49bab4ae6dfa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:58.503994 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-aedf3784-3b97-4361-96b7-49bab4ae6dfa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:58.504510 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-aedf3784-3b97-4361-96b7-49bab4ae6dfa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:58.515713 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-aedf3784-3b97-4361-96b7-49bab4ae6dfa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:58.529943 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-aedf3784-3b97-4361-96b7-49bab4ae6dfa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:59.032920 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-aedf3784-3b97-4361-96b7-49bab4ae6dfa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:59.046818 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-aedf3784-3b97-4361-96b7-49bab4ae6dfa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.581323 Nov 02 16:48:59.057193 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 217/425] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:58 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:59.081932 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-42cd41de-5144-4b1c-9c26-6309781fd016 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:59.083174 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-42cd41de-5144-4b1c-9c26-6309781fd016 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:59.111982 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-42cd41de-5144-4b1c-9c26-6309781fd016 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:59.113282 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-42cd41de-5144-4b1c-9c26-6309781fd016 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:59.115129 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-42cd41de-5144-4b1c-9c26-6309781fd016 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:59.119200 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-42cd41de-5144-4b1c-9c26-6309781fd016 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:59.274407 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-42cd41de-5144-4b1c-9c26-6309781fd016 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28638 microversion: 2.20 time: 0.204390 Nov 02 16:48:59.275330 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 218/426] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:48:59 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28638 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:48:59.287775 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7a128e34-a50a-421a-82c5-68d03003f343 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:48:59.293030 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7a128e34-a50a-421a-82c5-68d03003f343 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:48:59.297586 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7bcc3fa5-04c1-4c20-ab0b-65e64d650359 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:48:59.306037 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7a128e34-a50a-421a-82c5-68d03003f343 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:59.306692 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7a128e34-a50a-421a-82c5-68d03003f343 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:59.307909 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7a128e34-a50a-421a-82c5-68d03003f343 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:48:59.309301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7a128e34-a50a-421a-82c5-68d03003f343 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:48:59.319952 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7bcc3fa5-04c1-4c20-ab0b-65e64d650359 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1274 microversion: 2.1 time: 1.018425 Nov 02 16:48:59.321179 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 209/427] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:48:58 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1274 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:48:59.508679 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7a128e34-a50a-421a-82c5-68d03003f343 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28757 microversion: 2.1 time: 0.231396 Nov 02 16:48:59.510194 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 219/428] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:48:59 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28757 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:00.076938 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e458790b-5785-4d6a-b0d5-5501d965c03f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:00.077648 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e458790b-5785-4d6a-b0d5-5501d965c03f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:00.091089 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e458790b-5785-4d6a-b0d5-5501d965c03f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:00.091902 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e458790b-5785-4d6a-b0d5-5501d965c03f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:00.102641 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e458790b-5785-4d6a-b0d5-5501d965c03f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:00.103847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e458790b-5785-4d6a-b0d5-5501d965c03f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:00.292495 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-284c8dee-8dd6-4b21-aabd-840ee1625126 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:00.294500 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-284c8dee-8dd6-4b21-aabd-840ee1625126 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:00.310395 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-284c8dee-8dd6-4b21-aabd-840ee1625126 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:00.311490 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-284c8dee-8dd6-4b21-aabd-840ee1625126 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:00.313098 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-284c8dee-8dd6-4b21-aabd-840ee1625126 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:00.315453 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-284c8dee-8dd6-4b21-aabd-840ee1625126 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:00.449031 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-284c8dee-8dd6-4b21-aabd-840ee1625126 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28638 microversion: 2.20 time: 0.163861 Nov 02 16:49:00.451231 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 220/429] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:00 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28638 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:49:00.463854 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-347ce2ea-af2a-4486-856c-8731acbab05a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:00.463854 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-347ce2ea-af2a-4486-856c-8731acbab05a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:00.487047 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-347ce2ea-af2a-4486-856c-8731acbab05a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:00.487531 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-347ce2ea-af2a-4486-856c-8731acbab05a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:00.492822 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-347ce2ea-af2a-4486-856c-8731acbab05a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:00.493761 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-347ce2ea-af2a-4486-856c-8731acbab05a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:00.702912 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-347ce2ea-af2a-4486-856c-8731acbab05a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:00.729742 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-347ce2ea-af2a-4486-856c-8731acbab05a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1280 microversion: 2.1 time: 0.276069 Nov 02 16:49:00.731449 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 221/430] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:00 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1280 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:00.740613 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-32b582c3-6437-4234-9d06-adad568afe99 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:00.747686 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-32b582c3-6437-4234-9d06-adad568afe99 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:00.768368 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-32b582c3-6437-4234-9d06-adad568afe99 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:00.769320 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-32b582c3-6437-4234-9d06-adad568afe99 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:00.771005 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-32b582c3-6437-4234-9d06-adad568afe99 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:00.773189 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-32b582c3-6437-4234-9d06-adad568afe99 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:00.885539 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-32b582c3-6437-4234-9d06-adad568afe99 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28757 microversion: 2.1 time: 0.152007 Nov 02 16:49:00.886592 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 222/431] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:00 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28757 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:01.031611 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e458790b-5785-4d6a-b0d5-5501d965c03f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:01.052371 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e458790b-5785-4d6a-b0d5-5501d965c03f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.979972 Nov 02 16:49:01.054768 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 210/432] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:00 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:01.466934 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-81189a64-45f9-4ea6-9720-218dcc7aed8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:01.472012 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-81189a64-45f9-4ea6-9720-218dcc7aed8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:01.503507 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-81189a64-45f9-4ea6-9720-218dcc7aed8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:01.512281 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-81189a64-45f9-4ea6-9720-218dcc7aed8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:01.515782 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-81189a64-45f9-4ea6-9720-218dcc7aed8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:01.519857 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-81189a64-45f9-4ea6-9720-218dcc7aed8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:01.698706 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-81189a64-45f9-4ea6-9720-218dcc7aed8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28638 microversion: 2.20 time: 0.236794 Nov 02 16:49:01.703963 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 223/433] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:01 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28638 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:01.770953 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4bfcb47e-6ba4-4c5a-8914-ebd03b54ccd3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:01.772533 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4bfcb47e-6ba4-4c5a-8914-ebd03b54ccd3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:01.812969 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4bfcb47e-6ba4-4c5a-8914-ebd03b54ccd3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:01.814617 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4bfcb47e-6ba4-4c5a-8914-ebd03b54ccd3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:01.820555 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4bfcb47e-6ba4-4c5a-8914-ebd03b54ccd3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:01.828837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4bfcb47e-6ba4-4c5a-8914-ebd03b54ccd3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:01.911076 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0b97a0f8-5672-4b68-b71c-1633543f7e69 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:01.929405 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0b97a0f8-5672-4b68-b71c-1633543f7e69 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:01.944907 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b97a0f8-5672-4b68-b71c-1633543f7e69 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:01.952476 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b97a0f8-5672-4b68-b71c-1633543f7e69 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:01.953837 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b97a0f8-5672-4b68-b71c-1633543f7e69 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:01.955845 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b97a0f8-5672-4b68-b71c-1633543f7e69 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:02.118751 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0b97a0f8-5672-4b68-b71c-1633543f7e69 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28757 microversion: 2.1 time: 0.219308 Nov 02 16:49:02.123506 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 224/434] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:01 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28757 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:49:02.144271 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1a14d78c-832a-46d2-b941-4980dc9b257f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:02.147521 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1a14d78c-832a-46d2-b941-4980dc9b257f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:02.180719 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a14d78c-832a-46d2-b941-4980dc9b257f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:02.183754 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a14d78c-832a-46d2-b941-4980dc9b257f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:02.189563 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a14d78c-832a-46d2-b941-4980dc9b257f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:02.192958 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a14d78c-832a-46d2-b941-4980dc9b257f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:02.602287 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1a14d78c-832a-46d2-b941-4980dc9b257f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:02.630834 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1a14d78c-832a-46d2-b941-4980dc9b257f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.505302 Nov 02 16:49:02.637192 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 225/435] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:02 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:02.716662 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-afbabb95-a5f2-49ba-8830-a38b8348b514 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:02.717722 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-afbabb95-a5f2-49ba-8830-a38b8348b514 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:02.750335 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-afbabb95-a5f2-49ba-8830-a38b8348b514 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:02.750806 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-afbabb95-a5f2-49ba-8830-a38b8348b514 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:02.751791 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-afbabb95-a5f2-49ba-8830-a38b8348b514 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:02.752349 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-afbabb95-a5f2-49ba-8830-a38b8348b514 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:02.910360 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-afbabb95-a5f2-49ba-8830-a38b8348b514 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28638 microversion: 2.20 time: 0.201545 Nov 02 16:49:02.911672 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 226/436] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:02 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28638 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:03.028838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4bfcb47e-6ba4-4c5a-8914-ebd03b54ccd3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:03.045786 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4bfcb47e-6ba4-4c5a-8914-ebd03b54ccd3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1322 microversion: 2.1 time: 1.290277 Nov 02 16:49:03.050356 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 211/437] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:01 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1322 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:03.140778 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a63fa3c0-2eec-4860-b51e-5ee70f37d9f5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:03.143106 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a63fa3c0-2eec-4860-b51e-5ee70f37d9f5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:03.184582 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a63fa3c0-2eec-4860-b51e-5ee70f37d9f5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:03.186180 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a63fa3c0-2eec-4860-b51e-5ee70f37d9f5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:03.194361 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a63fa3c0-2eec-4860-b51e-5ee70f37d9f5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:03.195227 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a63fa3c0-2eec-4860-b51e-5ee70f37d9f5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:03.414480 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a63fa3c0-2eec-4860-b51e-5ee70f37d9f5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 28757 microversion: 2.1 time: 0.280064 Nov 02 16:49:03.421983 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 227/438] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:03 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 28757 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:03.656037 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d754343a-bff5-4945-9113-4dff4e2f8060 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:03.658559 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d754343a-bff5-4945-9113-4dff4e2f8060 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:03.667696 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d754343a-bff5-4945-9113-4dff4e2f8060 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:03.669696 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d754343a-bff5-4945-9113-4dff4e2f8060 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:03.671003 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d754343a-bff5-4945-9113-4dff4e2f8060 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:03.671854 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d754343a-bff5-4945-9113-4dff4e2f8060 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:03.926685 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-17a06966-27e7-4b6d-bc14-c13e68668887 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:03.928155 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-17a06966-27e7-4b6d-bc14-c13e68668887 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:03.936976 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-17a06966-27e7-4b6d-bc14-c13e68668887 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:03.937914 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-17a06966-27e7-4b6d-bc14-c13e68668887 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:03.939415 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-17a06966-27e7-4b6d-bc14-c13e68668887 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:03.940387 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-17a06966-27e7-4b6d-bc14-c13e68668887 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:04.079645 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d754343a-bff5-4945-9113-4dff4e2f8060 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:04.084538 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-17a06966-27e7-4b6d-bc14-c13e68668887 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 28638 microversion: 2.20 time: 0.163042 Nov 02 16:49:04.088961 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 228/439] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:03 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 28638 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:04.092707 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d754343a-bff5-4945-9113-4dff4e2f8060 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.442000 Nov 02 16:49:04.098978 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 212/440] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:03 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:04.103033 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4956b2e8-14fb-473b-b36d-cf92b1682645 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:04.104089 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4956b2e8-14fb-473b-b36d-cf92b1682645 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:04.122107 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4956b2e8-14fb-473b-b36d-cf92b1682645 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:04.122848 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4956b2e8-14fb-473b-b36d-cf92b1682645 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:04.123876 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4956b2e8-14fb-473b-b36d-cf92b1682645 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:04.124638 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4956b2e8-14fb-473b-b36d-cf92b1682645 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:04.435284 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f4b74797-9e5f-4f7b-b616-95475f69614a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:04.437215 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f4b74797-9e5f-4f7b-b616-95475f69614a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:04.453012 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f4b74797-9e5f-4f7b-b616-95475f69614a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:04.453388 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f4b74797-9e5f-4f7b-b616-95475f69614a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:04.462879 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f4b74797-9e5f-4f7b-b616-95475f69614a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:04.465763 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f4b74797-9e5f-4f7b-b616-95475f69614a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:04.495455 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-4956b2e8-14fb-473b-b36d-cf92b1682645 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:04.506259 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4956b2e8-14fb-473b-b36d-cf92b1682645 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1322 microversion: 2.1 time: 0.416230 Nov 02 16:49:04.512117 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 229/441] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:04 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:04.666297 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-23b63ad4-5baa-42b7-917a-ecacc4fced37 req-f5301a40-16dd-461e-b802-ddd3d8403050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a4ae9f-e986-4bf1-b110-04ccb11fa669", "tag": "ae111e5f-0dee-4333-97a4-4539e1360985"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:04.668837 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:49:04.668837 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:49:04.716380 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-23b63ad4-5baa-42b7-917a-ecacc4fced37 req-f5301a40-16dd-461e-b802-ddd3d8403050 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:04.717753 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-23b63ad4-5baa-42b7-917a-ecacc4fced37 req-f5301a40-16dd-461e-b802-ddd3d8403050 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:04.763531 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-23b63ad4-5baa-42b7-917a-ecacc4fced37 req-f5301a40-16dd-461e-b802-ddd3d8403050 service nova] Creating event network-changed:ae111e5f-0dee-4333-97a4-4539e1360985 for instance 62a4ae9f-e986-4bf1-b110-04ccb11fa669 on hv-cinder-77387 Nov 02 16:49:04.793879 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-23b63ad4-5baa-42b7-917a-ecacc4fced37 req-f5301a40-16dd-461e-b802-ddd3d8403050 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133835 Nov 02 16:49:04.795794 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 230/442] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:49:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:49:04.940918 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f4b74797-9e5f-4f7b-b616-95475f69614a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 29515 microversion: 2.1 time: 0.513765 Nov 02 16:49:04.942778 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 213/443] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:04 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 29515 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:49:05.100124 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a7d670f8-15b3-4516-b30c-103bf33630ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:05.102465 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a7d670f8-15b3-4516-b30c-103bf33630ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:05.113353 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5866b974-703d-430d-ba1a-ac668deffbe9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:05.114111 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5866b974-703d-430d-ba1a-ac668deffbe9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:05.123311 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a7d670f8-15b3-4516-b30c-103bf33630ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:05.128941 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a7d670f8-15b3-4516-b30c-103bf33630ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:05.132624 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a7d670f8-15b3-4516-b30c-103bf33630ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:05.134525 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5866b974-703d-430d-ba1a-ac668deffbe9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:05.135733 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a7d670f8-15b3-4516-b30c-103bf33630ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:05.137292 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5866b974-703d-430d-ba1a-ac668deffbe9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:05.140891 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5866b974-703d-430d-ba1a-ac668deffbe9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:05.143039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5866b974-703d-430d-ba1a-ac668deffbe9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:05.281944 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a7d670f8-15b3-4516-b30c-103bf33630ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 29156 microversion: 2.20 time: 0.185371 Nov 02 16:49:05.285793 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 231/444] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:05 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 29156 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:05.531102 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9d17bc63-2ba0-4c2e-a6e4-2d054c5d4b8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:05.531849 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9d17bc63-2ba0-4c2e-a6e4-2d054c5d4b8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:05.557701 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9d17bc63-2ba0-4c2e-a6e4-2d054c5d4b8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:05.570926 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9d17bc63-2ba0-4c2e-a6e4-2d054c5d4b8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:05.571875 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9d17bc63-2ba0-4c2e-a6e4-2d054c5d4b8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:05.572407 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9d17bc63-2ba0-4c2e-a6e4-2d054c5d4b8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:05.675245 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5866b974-703d-430d-ba1a-ac668deffbe9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:05.692941 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5866b974-703d-430d-ba1a-ac668deffbe9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.581266 Nov 02 16:49:05.695115 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 214/445] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:05 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:05.878204 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-9d17bc63-2ba0-4c2e-a6e4-2d054c5d4b8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:05.895647 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9d17bc63-2ba0-4c2e-a6e4-2d054c5d4b8d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1322 microversion: 2.1 time: 0.364357 Nov 02 16:49:05.902003 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 232/446] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:05 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:05.955106 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-8882c2cf-96cf-4357-95fe-9386deae75b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:05.956508 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8882c2cf-96cf-4357-95fe-9386deae75b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:05.975627 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8882c2cf-96cf-4357-95fe-9386deae75b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:05.976227 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8882c2cf-96cf-4357-95fe-9386deae75b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:05.986382 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8882c2cf-96cf-4357-95fe-9386deae75b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:05.986855 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8882c2cf-96cf-4357-95fe-9386deae75b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:06.170892 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-8882c2cf-96cf-4357-95fe-9386deae75b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 30305 microversion: 2.1 time: 0.220081 Nov 02 16:49:06.177152 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 215/447] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:05 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 30305 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:06.301776 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1fa51209-9378-4fbe-9a08-dfc415a2d880 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:06.304164 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1fa51209-9378-4fbe-9a08-dfc415a2d880 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:06.315550 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1fa51209-9378-4fbe-9a08-dfc415a2d880 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:06.316500 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1fa51209-9378-4fbe-9a08-dfc415a2d880 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:06.317554 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1fa51209-9378-4fbe-9a08-dfc415a2d880 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:06.318049 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1fa51209-9378-4fbe-9a08-dfc415a2d880 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:06.456568 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1fa51209-9378-4fbe-9a08-dfc415a2d880 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 29841 microversion: 2.20 time: 0.162081 Nov 02 16:49:06.458148 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 233/448] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:06 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 29841 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:06.713937 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-44fc5ae9-e0ed-4970-98ae-fa140b550592 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:06.715727 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-44fc5ae9-e0ed-4970-98ae-fa140b550592 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:06.726140 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-44fc5ae9-e0ed-4970-98ae-fa140b550592 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:06.727306 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-44fc5ae9-e0ed-4970-98ae-fa140b550592 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:06.728544 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-44fc5ae9-e0ed-4970-98ae-fa140b550592 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:06.729312 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-44fc5ae9-e0ed-4970-98ae-fa140b550592 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:06.912657 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-af873d5e-8473-472a-be56-951bc73e9931 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:06.913580 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-af873d5e-8473-472a-be56-951bc73e9931 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:06.929431 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-af873d5e-8473-472a-be56-951bc73e9931 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:06.930483 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-af873d5e-8473-472a-be56-951bc73e9931 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:06.931803 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-af873d5e-8473-472a-be56-951bc73e9931 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:06.934054 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-af873d5e-8473-472a-be56-951bc73e9931 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:07.166904 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-af873d5e-8473-472a-be56-951bc73e9931 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:07.186515 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-af873d5e-8473-472a-be56-951bc73e9931 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1322 microversion: 2.1 time: 0.281380 Nov 02 16:49:07.192048 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 234/449] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:06 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:07.201093 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9a3d3fd4-60d0-47a4-b392-6c6edfafc15f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:07.202601 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9a3d3fd4-60d0-47a4-b392-6c6edfafc15f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:07.211834 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9a3d3fd4-60d0-47a4-b392-6c6edfafc15f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:07.212760 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9a3d3fd4-60d0-47a4-b392-6c6edfafc15f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:07.213931 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9a3d3fd4-60d0-47a4-b392-6c6edfafc15f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:07.215326 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9a3d3fd4-60d0-47a4-b392-6c6edfafc15f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:07.367042 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9a3d3fd4-60d0-47a4-b392-6c6edfafc15f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 31048 microversion: 2.1 time: 0.171909 Nov 02 16:49:07.370477 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 235/450] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:07 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 31048 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:07.451741 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-44fc5ae9-e0ed-4970-98ae-fa140b550592 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:07.462306 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-44fc5ae9-e0ed-4970-98ae-fa140b550592 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1505 microversion: 2.1 time: 0.754036 Nov 02 16:49:07.472116 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 216/451] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:06 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1505 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:07.472420 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5aab1e77-3ecb-4566-b64d-95097d4e84ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:07.473728 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5aab1e77-3ecb-4566-b64d-95097d4e84ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:07.485068 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5aab1e77-3ecb-4566-b64d-95097d4e84ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:07.485412 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cba5291d-4ff6-4a3a-889b-b72641e96342 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab67c040-1bf3-44c5-969c-bd26eda73937"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:07.486325 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5aab1e77-3ecb-4566-b64d-95097d4e84ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:07.487481 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-cba5291d-4ff6-4a3a-889b-b72641e96342 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:07.487772 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5aab1e77-3ecb-4566-b64d-95097d4e84ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:07.489784 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5aab1e77-3ecb-4566-b64d-95097d4e84ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:07.497157 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cba5291d-4ff6-4a3a-889b-b72641e96342 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:07.497625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cba5291d-4ff6-4a3a-889b-b72641e96342 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:07.498845 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cba5291d-4ff6-4a3a-889b-b72641e96342 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:07.499490 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cba5291d-4ff6-4a3a-889b-b72641e96342 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:07.535729 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-cba5291d-4ff6-4a3a-889b-b72641e96342 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] HTTP exception thrown: Cannot 'attach_volume' instance 6e5b406e-d37d-44b0-bb2f-39532baf3f9e while it is in vm_state rescued Nov 02 16:49:07.536609 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cba5291d-4ff6-4a3a-889b-b72641e96342 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Returning 409 to user: Cannot 'attach_volume' instance 6e5b406e-d37d-44b0-bb2f-39532baf3f9e while it is in vm_state rescued {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:49:07.537698 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-cba5291d-4ff6-4a3a-889b-b72641e96342 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "POST /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059122 Nov 02 16:49:07.541993 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 217/452] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:49:07 2021] POST /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 16:49:07.547798 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-72ddd4bb-310e-4438-86e5-64aac4cae655 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:07.548431 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-72ddd4bb-310e-4438-86e5-64aac4cae655 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:07.580778 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-72ddd4bb-310e-4438-86e5-64aac4cae655 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:07.580955 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-72ddd4bb-310e-4438-86e5-64aac4cae655 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:07.581715 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-72ddd4bb-310e-4438-86e5-64aac4cae655 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:07.582147 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-72ddd4bb-310e-4438-86e5-64aac4cae655 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:07.653656 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5aab1e77-3ecb-4566-b64d-95097d4e84ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 30503 microversion: 2.20 time: 0.187564 Nov 02 16:49:07.659361 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 236/453] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:07 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 30503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:49:07.692968 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-72ddd4bb-310e-4438-86e5-64aac4cae655 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "POST /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.149352 Nov 02 16:49:07.694470 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 218/454] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:07 2021] POST /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:07.704847 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6b0ec3c2-19fc-420d-ad23-3aa5dacc1190 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:07.705596 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6b0ec3c2-19fc-420d-ad23-3aa5dacc1190 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:07.717213 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6b0ec3c2-19fc-420d-ad23-3aa5dacc1190 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:07.717962 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6b0ec3c2-19fc-420d-ad23-3aa5dacc1190 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:07.719031 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6b0ec3c2-19fc-420d-ad23-3aa5dacc1190 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:07.720676 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6b0ec3c2-19fc-420d-ad23-3aa5dacc1190 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:07.933832 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6b0ec3c2-19fc-420d-ad23-3aa5dacc1190 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:07.949650 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6b0ec3c2-19fc-420d-ad23-3aa5dacc1190 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1513 microversion: 2.1 time: 0.250057 Nov 02 16:49:07.951806 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 237/455] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:07 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:08.213103 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-15668ba2-c207-4d97-9a60-0b1ca94e9730 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:08.214374 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-15668ba2-c207-4d97-9a60-0b1ca94e9730 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:08.231203 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-15668ba2-c207-4d97-9a60-0b1ca94e9730 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:08.232842 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-15668ba2-c207-4d97-9a60-0b1ca94e9730 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:08.234217 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-15668ba2-c207-4d97-9a60-0b1ca94e9730 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:08.234941 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-15668ba2-c207-4d97-9a60-0b1ca94e9730 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:08.386565 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-af79274c-318c-42c4-b5a0-6a40203039ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:08.393463 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-af79274c-318c-42c4-b5a0-6a40203039ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:08.439524 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-af79274c-318c-42c4-b5a0-6a40203039ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:08.461939 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-af79274c-318c-42c4-b5a0-6a40203039ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:08.463876 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-af79274c-318c-42c4-b5a0-6a40203039ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:08.464795 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-af79274c-318c-42c4-b5a0-6a40203039ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:08.633688 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-15668ba2-c207-4d97-9a60-0b1ca94e9730 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:08.653289 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-15668ba2-c207-4d97-9a60-0b1ca94e9730 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1322 microversion: 2.1 time: 0.442568 Nov 02 16:49:08.657673 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 219/456] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:08 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:08.682694 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-af79274c-318c-42c4-b5a0-6a40203039ed tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 31617 microversion: 2.1 time: 0.306446 Nov 02 16:49:08.683480 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 238/457] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:08 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 31617 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:08.693474 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6e882db5-ca0e-4307-b58b-b17c8d411a77 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:08.694781 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6e882db5-ca0e-4307-b58b-b17c8d411a77 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:08.704672 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6e882db5-ca0e-4307-b58b-b17c8d411a77 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:08.705821 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6e882db5-ca0e-4307-b58b-b17c8d411a77 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:08.706970 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6e882db5-ca0e-4307-b58b-b17c8d411a77 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:08.707661 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6e882db5-ca0e-4307-b58b-b17c8d411a77 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:08.841515 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6e882db5-ca0e-4307-b58b-b17c8d411a77 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 31115 microversion: 2.20 time: 0.175472 Nov 02 16:49:08.842303 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 220/458] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:08 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 31115 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:08.970204 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1e09ef0c-6caa-4406-864c-6d57bd8cdad0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:08.970981 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1e09ef0c-6caa-4406-864c-6d57bd8cdad0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:08.986556 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1e09ef0c-6caa-4406-864c-6d57bd8cdad0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:08.987143 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1e09ef0c-6caa-4406-864c-6d57bd8cdad0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:08.996163 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1e09ef0c-6caa-4406-864c-6d57bd8cdad0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:09.002986 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1e09ef0c-6caa-4406-864c-6d57bd8cdad0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:09.403651 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1e09ef0c-6caa-4406-864c-6d57bd8cdad0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:09.429810 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1e09ef0c-6caa-4406-864c-6d57bd8cdad0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1513 microversion: 2.1 time: 0.464196 Nov 02 16:49:09.432092 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 239/459] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:08 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1513 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:49:09.687885 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6031a7d2-a94a-4762-ae25-3f69c6b28387 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:09.697400 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6e19fcd7-fc87-4fbf-b7aa-717b356fc01c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:09.699249 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6e19fcd7-fc87-4fbf-b7aa-717b356fc01c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:09.701527 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6031a7d2-a94a-4762-ae25-3f69c6b28387 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:09.718783 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6e19fcd7-fc87-4fbf-b7aa-717b356fc01c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:09.720366 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6e19fcd7-fc87-4fbf-b7aa-717b356fc01c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:09.721936 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6e19fcd7-fc87-4fbf-b7aa-717b356fc01c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:09.722822 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6e19fcd7-fc87-4fbf-b7aa-717b356fc01c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:09.732325 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6031a7d2-a94a-4762-ae25-3f69c6b28387 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:09.737936 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6031a7d2-a94a-4762-ae25-3f69c6b28387 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:09.739582 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6031a7d2-a94a-4762-ae25-3f69c6b28387 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:09.739686 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6031a7d2-a94a-4762-ae25-3f69c6b28387 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:09.943249 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6e19fcd7-fc87-4fbf-b7aa-717b356fc01c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 32307 microversion: 2.1 time: 0.251248 Nov 02 16:49:09.944903 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 240/460] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:09 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 32307 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:49:09.951100 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-aa95ddf9-4cc4-4d29-afce-04f587faab35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:09.958865 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-aa95ddf9-4cc4-4d29-afce-04f587faab35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:09.980767 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-aa95ddf9-4cc4-4d29-afce-04f587faab35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:09.981135 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-aa95ddf9-4cc4-4d29-afce-04f587faab35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:09.985183 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-aa95ddf9-4cc4-4d29-afce-04f587faab35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:09.986679 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-aa95ddf9-4cc4-4d29-afce-04f587faab35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:10.029976 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6031a7d2-a94a-4762-ae25-3f69c6b28387 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:10.041558 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6031a7d2-a94a-4762-ae25-3f69c6b28387 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1322 microversion: 2.1 time: 0.358453 Nov 02 16:49:10.043150 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 221/461] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:09 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:10.117186 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-aa95ddf9-4cc4-4d29-afce-04f587faab35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 31708 microversion: 2.20 time: 0.170400 Nov 02 16:49:10.120535 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 241/462] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:09 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 31708 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:10.451098 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-99f48224-87c0-4804-b0f1-ac880f9b49cf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:10.451763 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-99f48224-87c0-4804-b0f1-ac880f9b49cf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:10.461931 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-99f48224-87c0-4804-b0f1-ac880f9b49cf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:10.463343 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-99f48224-87c0-4804-b0f1-ac880f9b49cf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:10.464977 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-99f48224-87c0-4804-b0f1-ac880f9b49cf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:10.465628 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-99f48224-87c0-4804-b0f1-ac880f9b49cf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:10.868788 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-99f48224-87c0-4804-b0f1-ac880f9b49cf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:10.880888 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-99f48224-87c0-4804-b0f1-ac880f9b49cf tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1513 microversion: 2.1 time: 0.435107 Nov 02 16:49:10.883062 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 222/463] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:10 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1513 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:10.960417 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-103434f0-b6e9-42e0-83a9-fef25d334ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:10.961691 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-103434f0-b6e9-42e0-83a9-fef25d334ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:10.979730 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-103434f0-b6e9-42e0-83a9-fef25d334ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:10.980227 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-103434f0-b6e9-42e0-83a9-fef25d334ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:10.981081 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-103434f0-b6e9-42e0-83a9-fef25d334ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:10.981526 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-103434f0-b6e9-42e0-83a9-fef25d334ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:11.059999 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-775d0d0b-e47a-4306-8d87-283a76fdcaf5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:11.060702 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-775d0d0b-e47a-4306-8d87-283a76fdcaf5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:11.082754 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-775d0d0b-e47a-4306-8d87-283a76fdcaf5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:11.084932 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-775d0d0b-e47a-4306-8d87-283a76fdcaf5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:11.086111 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-775d0d0b-e47a-4306-8d87-283a76fdcaf5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:11.089108 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-775d0d0b-e47a-4306-8d87-283a76fdcaf5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:11.179876 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-103434f0-b6e9-42e0-83a9-fef25d334ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 32865 microversion: 2.1 time: 0.224506 Nov 02 16:49:11.179876 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 242/464] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:10 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 32865 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:11.187573 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-afbb7bf8-8a45-49d5-9be4-ac59c016cddf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:11.189570 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-afbb7bf8-8a45-49d5-9be4-ac59c016cddf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:11.228905 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-afbb7bf8-8a45-49d5-9be4-ac59c016cddf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:11.229369 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-afbb7bf8-8a45-49d5-9be4-ac59c016cddf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:11.230517 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-afbb7bf8-8a45-49d5-9be4-ac59c016cddf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:11.231147 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-afbb7bf8-8a45-49d5-9be4-ac59c016cddf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:11.386536 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-afbb7bf8-8a45-49d5-9be4-ac59c016cddf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 32359 microversion: 2.20 time: 0.202789 Nov 02 16:49:11.387796 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 243/465] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:11 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 32359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:11.453119 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-775d0d0b-e47a-4306-8d87-283a76fdcaf5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:11.463209 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-775d0d0b-e47a-4306-8d87-283a76fdcaf5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1322 microversion: 2.1 time: 0.407588 Nov 02 16:49:11.475237 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 223/466] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:11 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:11.902714 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e5285238-7756-47ad-b5a3-4bc6241749e9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:11.903468 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e5285238-7756-47ad-b5a3-4bc6241749e9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:11.923181 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e5285238-7756-47ad-b5a3-4bc6241749e9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:11.924438 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e5285238-7756-47ad-b5a3-4bc6241749e9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:11.926918 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e5285238-7756-47ad-b5a3-4bc6241749e9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:11.927938 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e5285238-7756-47ad-b5a3-4bc6241749e9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:12.196462 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e5285238-7756-47ad-b5a3-4bc6241749e9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:12.207057 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9755fbd5-8634-4196-9a77-ad3db5854927 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:12.211731 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9755fbd5-8634-4196-9a77-ad3db5854927 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:12.226313 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e5285238-7756-47ad-b5a3-4bc6241749e9 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1513 microversion: 2.1 time: 0.330340 Nov 02 16:49:12.235186 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9755fbd5-8634-4196-9a77-ad3db5854927 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:12.235664 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9755fbd5-8634-4196-9a77-ad3db5854927 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:12.236579 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9755fbd5-8634-4196-9a77-ad3db5854927 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:12.237046 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9755fbd5-8634-4196-9a77-ad3db5854927 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:12.250569 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 244/467] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:11 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1513 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:12.409580 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9755fbd5-8634-4196-9a77-ad3db5854927 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 33223 microversion: 2.1 time: 0.223204 Nov 02 16:49:12.415092 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 224/468] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:12 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 33223 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:12.415660 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-16d45003-0a2e-4c72-aaa2-8ea060ee2ff3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:12.417307 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-16d45003-0a2e-4c72-aaa2-8ea060ee2ff3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:12.433301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-16d45003-0a2e-4c72-aaa2-8ea060ee2ff3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:12.436461 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-16d45003-0a2e-4c72-aaa2-8ea060ee2ff3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:12.443074 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-16d45003-0a2e-4c72-aaa2-8ea060ee2ff3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:12.443946 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-16d45003-0a2e-4c72-aaa2-8ea060ee2ff3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:12.483234 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-213eaf70-00c0-4718-9f9a-2fd99d943efa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:12.485692 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-213eaf70-00c0-4718-9f9a-2fd99d943efa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:12.505794 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-213eaf70-00c0-4718-9f9a-2fd99d943efa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:12.508605 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-213eaf70-00c0-4718-9f9a-2fd99d943efa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:12.509814 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-213eaf70-00c0-4718-9f9a-2fd99d943efa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:12.512043 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-213eaf70-00c0-4718-9f9a-2fd99d943efa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:12.701573 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-16d45003-0a2e-4c72-aaa2-8ea060ee2ff3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 32593 microversion: 2.20 time: 0.301864 Nov 02 16:49:12.707497 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 245/469] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:12 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 32593 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:12.932058 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-213eaf70-00c0-4718-9f9a-2fd99d943efa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:12.947690 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-213eaf70-00c0-4718-9f9a-2fd99d943efa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1322 microversion: 2.1 time: 0.468922 Nov 02 16:49:12.952449 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 225/470] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:12 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:49:13.260597 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-496778e1-40ae-491b-b9b5-00e1185866c3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:13.272817 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-496778e1-40ae-491b-b9b5-00e1185866c3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:13.282843 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-496778e1-40ae-491b-b9b5-00e1185866c3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:13.283409 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-496778e1-40ae-491b-b9b5-00e1185866c3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:13.284463 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-496778e1-40ae-491b-b9b5-00e1185866c3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:13.286500 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-496778e1-40ae-491b-b9b5-00e1185866c3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:13.451569 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-79b7ede8-758c-4ed0-b7a0-df573b9efb42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:13.456987 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-79b7ede8-758c-4ed0-b7a0-df573b9efb42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:13.482876 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-79b7ede8-758c-4ed0-b7a0-df573b9efb42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:13.484759 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-79b7ede8-758c-4ed0-b7a0-df573b9efb42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:13.486542 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-79b7ede8-758c-4ed0-b7a0-df573b9efb42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:13.487469 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-79b7ede8-758c-4ed0-b7a0-df573b9efb42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:13.682218 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-79b7ede8-758c-4ed0-b7a0-df573b9efb42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 33445 microversion: 2.1 time: 0.236770 Nov 02 16:49:13.683899 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 226/471] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:13 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 33445 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:13.705875 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-496778e1-40ae-491b-b9b5-00e1185866c3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:13.721895 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a81abefb-f8f3-4608-a5d7-0e237cd68d35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:13.722252 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-496778e1-40ae-491b-b9b5-00e1185866c3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1519 microversion: 2.1 time: 0.467063 Nov 02 16:49:13.722900 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 246/472] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:13 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1519 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:13.731646 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a81abefb-f8f3-4608-a5d7-0e237cd68d35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:13.751358 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a81abefb-f8f3-4608-a5d7-0e237cd68d35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:13.753859 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a81abefb-f8f3-4608-a5d7-0e237cd68d35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:13.755979 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a81abefb-f8f3-4608-a5d7-0e237cd68d35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:13.757314 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a81abefb-f8f3-4608-a5d7-0e237cd68d35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:13.911563 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a81abefb-f8f3-4608-a5d7-0e237cd68d35 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 32958 microversion: 2.20 time: 0.195204 Nov 02 16:49:13.913475 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 227/473] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:13 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 32958 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:49:13.974241 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-519988d2-12a3-48d1-861a-3dfa022d2daa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:13.978293 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-519988d2-12a3-48d1-861a-3dfa022d2daa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:14.008391 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-519988d2-12a3-48d1-861a-3dfa022d2daa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:14.009668 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-519988d2-12a3-48d1-861a-3dfa022d2daa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:14.015143 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-519988d2-12a3-48d1-861a-3dfa022d2daa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:14.023585 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-519988d2-12a3-48d1-861a-3dfa022d2daa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:14.334189 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-519988d2-12a3-48d1-861a-3dfa022d2daa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:14.352065 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-519988d2-12a3-48d1-861a-3dfa022d2daa tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1322 microversion: 2.1 time: 0.386507 Nov 02 16:49:14.364399 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 247/474] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:13 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:14.700887 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-85d6f440-03ac-4ab9-98f9-f59d6ac23c10 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:14.703029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-85d6f440-03ac-4ab9-98f9-f59d6ac23c10 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:14.728348 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-85d6f440-03ac-4ab9-98f9-f59d6ac23c10 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:14.728978 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-85d6f440-03ac-4ab9-98f9-f59d6ac23c10 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:14.730362 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-85d6f440-03ac-4ab9-98f9-f59d6ac23c10 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:14.735606 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-85d6f440-03ac-4ab9-98f9-f59d6ac23c10 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:14.878026 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-85d6f440-03ac-4ab9-98f9-f59d6ac23c10 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 33734 microversion: 2.1 time: 0.185428 Nov 02 16:49:14.882868 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 228/475] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:14 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 33734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:14.926742 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-facae86d-81c8-4c86-80dd-1874f4ba20ed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:14.933921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-facae86d-81c8-4c86-80dd-1874f4ba20ed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:14.947532 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-facae86d-81c8-4c86-80dd-1874f4ba20ed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:14.947880 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-facae86d-81c8-4c86-80dd-1874f4ba20ed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:14.949076 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-facae86d-81c8-4c86-80dd-1874f4ba20ed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:14.949766 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-facae86d-81c8-4c86-80dd-1874f4ba20ed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:15.071848 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-facae86d-81c8-4c86-80dd-1874f4ba20ed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 33296 microversion: 2.20 time: 0.150087 Nov 02 16:49:15.073755 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 248/476] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:14 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 33296 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:15.296939 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-46dda288-d2c7-46bc-a59b-9c126baa9603 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:15.298206 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-46dda288-d2c7-46bc-a59b-9c126baa9603 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:15.309001 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-46dda288-d2c7-46bc-a59b-9c126baa9603 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:15.309599 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-46dda288-d2c7-46bc-a59b-9c126baa9603 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:15.310557 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-46dda288-d2c7-46bc-a59b-9c126baa9603 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:15.311094 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-46dda288-d2c7-46bc-a59b-9c126baa9603 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:15.378505 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-455050f7-7e8b-462b-9d9f-aa1ea43c683a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:15.380461 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-455050f7-7e8b-462b-9d9f-aa1ea43c683a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:15.395570 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-455050f7-7e8b-462b-9d9f-aa1ea43c683a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:15.398315 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-455050f7-7e8b-462b-9d9f-aa1ea43c683a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:15.411171 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-455050f7-7e8b-462b-9d9f-aa1ea43c683a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:15.411706 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-455050f7-7e8b-462b-9d9f-aa1ea43c683a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:15.504520 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-46dda288-d2c7-46bc-a59b-9c126baa9603 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:15.519270 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-46dda288-d2c7-46bc-a59b-9c126baa9603 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1519 microversion: 2.1 time: 0.226612 Nov 02 16:49:15.520728 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 229/477] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:15 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1519 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:15.544576 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-fb186d7f-ef9e-4ed0-92f9-2ee61f72d7d0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "431aaf37-701b-4ec1-a365-72ff60d64d09"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:15.547910 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-fb186d7f-ef9e-4ed0-92f9-2ee61f72d7d0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:15.558064 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fb186d7f-ef9e-4ed0-92f9-2ee61f72d7d0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:15.558801 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fb186d7f-ef9e-4ed0-92f9-2ee61f72d7d0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:15.559831 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fb186d7f-ef9e-4ed0-92f9-2ee61f72d7d0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:15.560568 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fb186d7f-ef9e-4ed0-92f9-2ee61f72d7d0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:15.705254 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-455050f7-7e8b-462b-9d9f-aa1ea43c683a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:15.720472 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-455050f7-7e8b-462b-9d9f-aa1ea43c683a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1322 microversion: 2.1 time: 0.350456 Nov 02 16:49:15.730885 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 249/478] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:15 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:15.895909 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bc347ca9-bc84-4ca8-8178-dea7a0a988a7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:15.897876 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-bc347ca9-bc84-4ca8-8178-dea7a0a988a7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:15.911504 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bc347ca9-bc84-4ca8-8178-dea7a0a988a7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:15.912721 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bc347ca9-bc84-4ca8-8178-dea7a0a988a7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:15.914727 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bc347ca9-bc84-4ca8-8178-dea7a0a988a7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:15.916000 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bc347ca9-bc84-4ca8-8178-dea7a0a988a7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:16.032992 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-fb186d7f-ef9e-4ed0-92f9-2ee61f72d7d0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "POST /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.498392 Nov 02 16:49:16.050390 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 230/479] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:49:15 2021] POST /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:49:16.095777 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1bc2b9d0-e54c-4514-88bf-12f43121372e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:16.097692 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1bc2b9d0-e54c-4514-88bf-12f43121372e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:16.115246 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-bc347ca9-bc84-4ca8-8178-dea7a0a988a7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 34173 microversion: 2.1 time: 0.219151 Nov 02 16:49:16.117254 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 250/480] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:15 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 34173 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:49:16.133437 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1bc2b9d0-e54c-4514-88bf-12f43121372e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:16.133918 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1bc2b9d0-e54c-4514-88bf-12f43121372e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:16.134799 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1bc2b9d0-e54c-4514-88bf-12f43121372e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:16.135639 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1bc2b9d0-e54c-4514-88bf-12f43121372e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:16.308645 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1bc2b9d0-e54c-4514-88bf-12f43121372e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 33703 microversion: 2.20 time: 0.222274 Nov 02 16:49:16.314808 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 231/481] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:16 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 33703 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:16.739664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9ce4bec7-ec18-44bb-89d7-877499e74099 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:16.741114 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9ce4bec7-ec18-44bb-89d7-877499e74099 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:16.750173 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9ce4bec7-ec18-44bb-89d7-877499e74099 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:16.752216 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9ce4bec7-ec18-44bb-89d7-877499e74099 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:16.753427 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9ce4bec7-ec18-44bb-89d7-877499e74099 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:16.754157 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9ce4bec7-ec18-44bb-89d7-877499e74099 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:16.841279 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-e0184999-9fdf-4f54-b385-6d7f69c72b94 req-7823c6c3-2df4-46e5-9984-6fca26cd72db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a4ae9f-e986-4bf1-b110-04ccb11fa669", "name": "network-vif-plugged", "status": "completed", "tag": "ae111e5f-0dee-4333-97a4-4539e1360985"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:16.843516 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:49:16.843516 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:49:16.863183 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-e0184999-9fdf-4f54-b385-6d7f69c72b94 req-7823c6c3-2df4-46e5-9984-6fca26cd72db service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:16.868769 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-e0184999-9fdf-4f54-b385-6d7f69c72b94 req-7823c6c3-2df4-46e5-9984-6fca26cd72db service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:16.901190 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-e0184999-9fdf-4f54-b385-6d7f69c72b94 req-7823c6c3-2df4-46e5-9984-6fca26cd72db service nova] Creating event network-vif-plugged:ae111e5f-0dee-4333-97a4-4539e1360985 for instance 62a4ae9f-e986-4bf1-b110-04ccb11fa669 on hv-cinder-77387 Nov 02 16:49:16.914221 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-e0184999-9fdf-4f54-b385-6d7f69c72b94 req-7823c6c3-2df4-46e5-9984-6fca26cd72db service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082319 Nov 02 16:49:16.914908 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 232/482] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:49:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:49:17.015645 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-9ce4bec7-ec18-44bb-89d7-877499e74099 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:17.027529 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9ce4bec7-ec18-44bb-89d7-877499e74099 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1322 microversion: 2.1 time: 0.292228 Nov 02 16:49:17.028861 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 251/483] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:16 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:17.130289 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-957bd470-46d2-4b53-a040-d2118fc6f7c8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:17.132393 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-957bd470-46d2-4b53-a040-d2118fc6f7c8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:17.161447 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-957bd470-46d2-4b53-a040-d2118fc6f7c8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:17.164835 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-957bd470-46d2-4b53-a040-d2118fc6f7c8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:17.165892 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-957bd470-46d2-4b53-a040-d2118fc6f7c8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:17.166446 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-957bd470-46d2-4b53-a040-d2118fc6f7c8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:17.323305 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-682440a1-bf85-4877-b234-e66d963c69b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:17.325699 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-682440a1-bf85-4877-b234-e66d963c69b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:17.329809 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-957bd470-46d2-4b53-a040-d2118fc6f7c8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 34733 microversion: 2.1 time: 0.204775 Nov 02 16:49:17.330872 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 233/484] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:17 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 34733 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:17.338178 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-682440a1-bf85-4877-b234-e66d963c69b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:17.339161 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-682440a1-bf85-4877-b234-e66d963c69b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:17.340476 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-682440a1-bf85-4877-b234-e66d963c69b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:17.341225 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-682440a1-bf85-4877-b234-e66d963c69b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:17.739295 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-682440a1-bf85-4877-b234-e66d963c69b1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 34385 microversion: 2.20 time: 0.420387 Nov 02 16:49:17.740439 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 252/485] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:17 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 34385 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:18.049569 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-62758801-7920-4154-b5b0-b998c02c91da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:18.050517 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-62758801-7920-4154-b5b0-b998c02c91da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:18.058950 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-62758801-7920-4154-b5b0-b998c02c91da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:18.059426 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-62758801-7920-4154-b5b0-b998c02c91da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:18.061679 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-62758801-7920-4154-b5b0-b998c02c91da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:18.061679 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-62758801-7920-4154-b5b0-b998c02c91da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:18.264153 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-62758801-7920-4154-b5b0-b998c02c91da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:18.273761 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-62758801-7920-4154-b5b0-b998c02c91da tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1322 microversion: 2.1 time: 0.230301 Nov 02 16:49:18.274398 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 234/486] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:18 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:18.346584 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-317fe758-cc6f-4f5e-9c70-9bbd5ec6379a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:18.348135 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-317fe758-cc6f-4f5e-9c70-9bbd5ec6379a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:18.356766 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-317fe758-cc6f-4f5e-9c70-9bbd5ec6379a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:18.357297 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-317fe758-cc6f-4f5e-9c70-9bbd5ec6379a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:18.358130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-317fe758-cc6f-4f5e-9c70-9bbd5ec6379a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:18.359003 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-317fe758-cc6f-4f5e-9c70-9bbd5ec6379a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:18.493693 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-317fe758-cc6f-4f5e-9c70-9bbd5ec6379a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 35149 microversion: 2.1 time: 0.153459 Nov 02 16:49:18.500540 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 253/487] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:18 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 35149 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:18.756062 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5701c4e0-4663-4521-8a68-e161295baff4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:18.757167 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5701c4e0-4663-4521-8a68-e161295baff4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:18.768892 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5701c4e0-4663-4521-8a68-e161295baff4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:18.769848 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5701c4e0-4663-4521-8a68-e161295baff4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:18.770943 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5701c4e0-4663-4521-8a68-e161295baff4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:18.771649 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5701c4e0-4663-4521-8a68-e161295baff4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:18.921744 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5701c4e0-4663-4521-8a68-e161295baff4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 35688 microversion: 2.20 time: 0.172396 Nov 02 16:49:18.923802 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 235/488] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:18 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 35688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:19.293541 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1a026b2d-0333-4fe4-aec9-2626a3e170cd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:19.294301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1a026b2d-0333-4fe4-aec9-2626a3e170cd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:19.302576 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a026b2d-0333-4fe4-aec9-2626a3e170cd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:19.303048 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a026b2d-0333-4fe4-aec9-2626a3e170cd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:19.304130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a026b2d-0333-4fe4-aec9-2626a3e170cd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:19.304630 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a026b2d-0333-4fe4-aec9-2626a3e170cd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:19.513306 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1a026b2d-0333-4fe4-aec9-2626a3e170cd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:19.516776 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5e8a283a-0656-4573-bccc-606be1299b6c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:19.525620 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1a026b2d-0333-4fe4-aec9-2626a3e170cd tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1322 microversion: 2.1 time: 0.236600 Nov 02 16:49:19.527217 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 254/489] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:19 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:19.530910 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5e8a283a-0656-4573-bccc-606be1299b6c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:19.556800 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5e8a283a-0656-4573-bccc-606be1299b6c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:19.557447 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5e8a283a-0656-4573-bccc-606be1299b6c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:19.558475 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5e8a283a-0656-4573-bccc-606be1299b6c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:19.559238 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5e8a283a-0656-4573-bccc-606be1299b6c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:19.742174 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5e8a283a-0656-4573-bccc-606be1299b6c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 35629 microversion: 2.1 time: 0.236340 Nov 02 16:49:19.744024 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 236/490] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:19 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 35629 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:19.936909 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1e26ab2b-1b65-4389-ae31-6da5ebf8b274 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:19.939491 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1e26ab2b-1b65-4389-ae31-6da5ebf8b274 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:19.947170 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1e26ab2b-1b65-4389-ae31-6da5ebf8b274 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:19.947785 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1e26ab2b-1b65-4389-ae31-6da5ebf8b274 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:19.948731 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1e26ab2b-1b65-4389-ae31-6da5ebf8b274 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:19.949478 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1e26ab2b-1b65-4389-ae31-6da5ebf8b274 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:20.093859 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1e26ab2b-1b65-4389-ae31-6da5ebf8b274 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 36182 microversion: 2.20 time: 0.160207 Nov 02 16:49:20.096662 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 255/491] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:19 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 36182 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:20.549871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1a21aa98-5eae-4459-9761-a7c146e74203 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:20.551737 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1a21aa98-5eae-4459-9761-a7c146e74203 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:20.566112 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1a21aa98-5eae-4459-9761-a7c146e74203 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:20.567285 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1a21aa98-5eae-4459-9761-a7c146e74203 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:20.569460 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1a21aa98-5eae-4459-9761-a7c146e74203 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:20.570862 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1a21aa98-5eae-4459-9761-a7c146e74203 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:20.757679 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-387a34ce-91dd-4091-a01a-e3a5a1b67b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:20.759854 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-387a34ce-91dd-4091-a01a-e3a5a1b67b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:20.773063 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-387a34ce-91dd-4091-a01a-e3a5a1b67b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:20.774299 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-387a34ce-91dd-4091-a01a-e3a5a1b67b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:20.775518 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-387a34ce-91dd-4091-a01a-e3a5a1b67b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:20.776398 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-387a34ce-91dd-4091-a01a-e3a5a1b67b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:20.846074 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1a21aa98-5eae-4459-9761-a7c146e74203 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:20.858173 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1a21aa98-5eae-4459-9761-a7c146e74203 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1511 microversion: 2.1 time: 0.313593 Nov 02 16:49:20.859291 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 237/492] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:20 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1511 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:20.962363 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-387a34ce-91dd-4091-a01a-e3a5a1b67b5a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 36948 microversion: 2.1 time: 0.209500 Nov 02 16:49:20.965688 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 256/493] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:20 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 36948 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:21.110324 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9aea1ea0-8ec4-47f5-967b-6a0f059033ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:21.112547 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9aea1ea0-8ec4-47f5-967b-6a0f059033ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:21.125180 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9aea1ea0-8ec4-47f5-967b-6a0f059033ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:21.125180 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9aea1ea0-8ec4-47f5-967b-6a0f059033ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:21.125180 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9aea1ea0-8ec4-47f5-967b-6a0f059033ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:21.125180 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9aea1ea0-8ec4-47f5-967b-6a0f059033ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:21.298869 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9aea1ea0-8ec4-47f5-967b-6a0f059033ba tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 36618 microversion: 2.20 time: 0.194222 Nov 02 16:49:21.301244 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 238/494] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:21 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 36618 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:21.977905 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b7d45c09-1094-49d3-b88c-b0845b5b3ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:21.980219 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b7d45c09-1094-49d3-b88c-b0845b5b3ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:21.996439 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7d45c09-1094-49d3-b88c-b0845b5b3ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:21.996915 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7d45c09-1094-49d3-b88c-b0845b5b3ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:21.997778 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7d45c09-1094-49d3-b88c-b0845b5b3ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:21.998264 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7d45c09-1094-49d3-b88c-b0845b5b3ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:22.160054 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6bad1f0b-174b-409a-af7a-151cc4871f74 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Action: 'create', calling method: .version_select at 0x7f112ee7d700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1485977986"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:22.160949 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b7d45c09-1094-49d3-b88c-b0845b5b3ca3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 37546 microversion: 2.1 time: 0.187572 Nov 02 16:49:22.161824 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 257/495] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:21 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 37546 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:22.183122 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-6bad1f0b-174b-409a-af7a-151cc4871f74 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Getting quotas for project 078aa8372f994f1eafe3013d58d8c979. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:49:22.188479 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-6bad1f0b-174b-409a-af7a-151cc4871f74 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Getting quotas for user 6140c6f52e2041aaa0a99a208c959b99 and project 078aa8372f994f1eafe3013d58d8c979. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:49:22.299528 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6f966ef4-3992-46f8-9e6e-42afd638beb9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7679362-afa7-4e85-882d-c426683486e8"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:22.300687 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6f966ef4-3992-46f8-9e6e-42afd638beb9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:22.309155 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6f966ef4-3992-46f8-9e6e-42afd638beb9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:22.309615 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6f966ef4-3992-46f8-9e6e-42afd638beb9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:22.310445 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6f966ef4-3992-46f8-9e6e-42afd638beb9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:22.310887 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6f966ef4-3992-46f8-9e6e-42afd638beb9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:22.428394 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-6bad1f0b-174b-409a-af7a-151cc4871f74 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Getting quotas for project 078aa8372f994f1eafe3013d58d8c979. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:49:22.433552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-6bad1f0b-174b-409a-af7a-151cc4871f74 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Getting quotas for user 6140c6f52e2041aaa0a99a208c959b99 and project 078aa8372f994f1eafe3013d58d8c979. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:49:22.449776 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6bad1f0b-174b-409a-af7a-151cc4871f74 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.295782 Nov 02 16:49:22.450580 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 239/496] 10.222.0.118 () {60 vars in 1162 bytes} [Tue Nov 2 16:49:22 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:22.458221 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ee0f37f2-dca4-483e-a7fd-fd1174b0c8ea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:22.460726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ee0f37f2-dca4-483e-a7fd-fd1174b0c8ea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:22.479072 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ee0f37f2-dca4-483e-a7fd-fd1174b0c8ea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:22.479565 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ee0f37f2-dca4-483e-a7fd-fd1174b0c8ea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:22.480569 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ee0f37f2-dca4-483e-a7fd-fd1174b0c8ea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:22.482053 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ee0f37f2-dca4-483e-a7fd-fd1174b0c8ea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:22.638309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ee0f37f2-dca4-483e-a7fd-fd1174b0c8ea tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 37166 microversion: 2.20 time: 0.186139 Nov 02 16:49:22.639525 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 240/497] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:22 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 37166 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:22.646254 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-8324974", "imageRef": "85427fe6-6680-4f2c-b899-a4ab17ea0665", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1485977986", "networks": [{"uuid": "feac3926-83aa-4c72-bcab-fa9f4d378711"}]}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:22.669122 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6f966ef4-3992-46f8-9e6e-42afd638beb9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "POST /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.374141 Nov 02 16:49:22.670491 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 258/498] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:49:22 2021] POST /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:49:22.714326 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.network.neutron [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] validate_networks() for [('feac3926-83aa-4c72-bcab-fa9f4d378711', None, None, None, None, None)] {{(pid=127648) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:49:23.177422 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-57c7b681-5f45-48d7-a209-fa2856b386db tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:23.178567 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-57c7b681-5f45-48d7-a209-fa2856b386db tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:23.185782 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-57c7b681-5f45-48d7-a209-fa2856b386db tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:23.186249 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-57c7b681-5f45-48d7-a209-fa2856b386db tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:23.187221 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-57c7b681-5f45-48d7-a209-fa2856b386db tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:23.187748 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-57c7b681-5f45-48d7-a209-fa2856b386db tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:23.200522 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Flavor limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:49:23.203162 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Image limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:49:23.204955 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Flavor pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:49:23.205960 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Image pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:49:23.207093 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:49:23.228119 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:23.228915 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:23.230366 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:23.230955 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:23.260110 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Getting quotas for project 078aa8372f994f1eafe3013d58d8c979. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:49:23.265770 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Getting quotas for user 6140c6f52e2041aaa0a99a208c959b99 and project 078aa8372f994f1eafe3013d58d8c979. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:49:23.282767 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Going to run 1 instances... {{(pid=127648) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:49:23.284670 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85427fe6-6680-4f2c-b899-a4ab17ea0665',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:49:23.335358 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-57c7b681-5f45-48d7-a209-fa2856b386db tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 37942 microversion: 2.1 time: 0.163214 Nov 02 16:49:23.336139 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 259/499] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:23 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 37942 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:23.346147 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-769c70d8-36ba-414f-a288-7226216a8cad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.705009 Nov 02 16:49:23.347354 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 241/500] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:49:22 2021] POST /compute/v2.1/servers => generated 382 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:49:23.359463 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2938e86b-5421-4d07-a2a8-82943ea0f920 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:23.362072 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2938e86b-5421-4d07-a2a8-82943ea0f920 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:23.442223 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2938e86b-5421-4d07-a2a8-82943ea0f920 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:23.452440 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2938e86b-5421-4d07-a2a8-82943ea0f920 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1260 microversion: 2.1 time: 0.097332 Nov 02 16:49:23.454364 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 260/501] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:23 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1260 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:49:23.653771 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4a594232-2ebb-43f3-9b09-ce4187092616 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:23.654943 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4a594232-2ebb-43f3-9b09-ce4187092616 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:23.667953 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a594232-2ebb-43f3-9b09-ce4187092616 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:23.667953 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a594232-2ebb-43f3-9b09-ce4187092616 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:23.668516 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a594232-2ebb-43f3-9b09-ce4187092616 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:23.668977 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a594232-2ebb-43f3-9b09-ce4187092616 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:23.852824 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4a594232-2ebb-43f3-9b09-ce4187092616 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 37773 microversion: 2.20 time: 0.202797 Nov 02 16:49:23.858747 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 242/502] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:23 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 37773 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:49:24.350828 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7c9b3ee6-8438-4f5d-8592-a42ccc70411b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:24.351936 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7c9b3ee6-8438-4f5d-8592-a42ccc70411b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:24.359811 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7c9b3ee6-8438-4f5d-8592-a42ccc70411b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:24.360493 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7c9b3ee6-8438-4f5d-8592-a42ccc70411b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:24.361333 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7c9b3ee6-8438-4f5d-8592-a42ccc70411b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:24.361779 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7c9b3ee6-8438-4f5d-8592-a42ccc70411b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:24.474664 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e7c36675-d48d-41c7-8ad6-9594473cdc0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:24.474664 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e7c36675-d48d-41c7-8ad6-9594473cdc0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:24.480468 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7c9b3ee6-8438-4f5d-8592-a42ccc70411b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 38190 microversion: 2.1 time: 0.133361 Nov 02 16:49:24.481524 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 261/503] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:24 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 38190 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:24.486224 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e7c36675-d48d-41c7-8ad6-9594473cdc0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:24.487066 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e7c36675-d48d-41c7-8ad6-9594473cdc0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:24.488659 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e7c36675-d48d-41c7-8ad6-9594473cdc0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:24.489480 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e7c36675-d48d-41c7-8ad6-9594473cdc0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:24.579907 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e7c36675-d48d-41c7-8ad6-9594473cdc0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:24.588407 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e7c36675-d48d-41c7-8ad6-9594473cdc0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1312 microversion: 2.1 time: 0.119848 Nov 02 16:49:24.589061 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 243/504] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:24 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:49:24.856980 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4ac05280-0034-4e79-b08c-c191706ddaaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:24.858664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4ac05280-0034-4e79-b08c-c191706ddaaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:24.867933 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7c3c5d3f-f861-4967-b2e3-ebf3b68fe4e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:24.868992 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7c3c5d3f-f861-4967-b2e3-ebf3b68fe4e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:24.872247 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ac05280-0034-4e79-b08c-c191706ddaaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:24.872722 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ac05280-0034-4e79-b08c-c191706ddaaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:24.873769 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ac05280-0034-4e79-b08c-c191706ddaaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:24.874389 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ac05280-0034-4e79-b08c-c191706ddaaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:24.878677 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7c3c5d3f-f861-4967-b2e3-ebf3b68fe4e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:24.879110 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7c3c5d3f-f861-4967-b2e3-ebf3b68fe4e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:24.879949 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7c3c5d3f-f861-4967-b2e3-ebf3b68fe4e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:24.880436 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7c3c5d3f-f861-4967-b2e3-ebf3b68fe4e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:24.910057 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-4ac05280-0034-4e79-b08c-c191706ddaaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lazy-loading 'flavor' on Instance uuid 6e5b406e-d37d-44b0-bb2f-39532baf3f9e {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:49:25.049362 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7c3c5d3f-f861-4967-b2e3-ebf3b68fe4e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 38110 microversion: 2.20 time: 0.185191 Nov 02 16:49:25.050573 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 244/505] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:24 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 38110 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:49:25.079850 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4ac05280-0034-4e79-b08c-c191706ddaaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "POST /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/action" status: 200 len: 32 microversion: 2.1 time: 0.228562 Nov 02 16:49:25.081251 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 262/506] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:24 2021] POST /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:49:25.099064 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e3d47840-b0d1-492c-a7ca-090888e5e680 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:25.101344 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e3d47840-b0d1-492c-a7ca-090888e5e680 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:25.111078 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e3d47840-b0d1-492c-a7ca-090888e5e680 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:25.111718 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e3d47840-b0d1-492c-a7ca-090888e5e680 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:25.112841 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e3d47840-b0d1-492c-a7ca-090888e5e680 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:25.113525 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e3d47840-b0d1-492c-a7ca-090888e5e680 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:25.446734 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e3d47840-b0d1-492c-a7ca-090888e5e680 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:25.463551 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e3d47840-b0d1-492c-a7ca-090888e5e680 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1571 microversion: 2.1 time: 0.375066 Nov 02 16:49:25.482492 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 245/507] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:25 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1571 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:49:25.496405 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1a238201-f72a-4069-8c21-4960e21997f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:25.498740 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1a238201-f72a-4069-8c21-4960e21997f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:25.507258 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a238201-f72a-4069-8c21-4960e21997f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:25.508468 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a238201-f72a-4069-8c21-4960e21997f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:25.509518 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a238201-f72a-4069-8c21-4960e21997f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:25.510168 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a238201-f72a-4069-8c21-4960e21997f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:25.608103 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-8c8d9618-576e-4039-bda7-49e6ffe1bedb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:25.608836 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8c8d9618-576e-4039-bda7-49e6ffe1bedb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:25.630396 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8c8d9618-576e-4039-bda7-49e6ffe1bedb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:25.631106 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8c8d9618-576e-4039-bda7-49e6ffe1bedb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:25.633080 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8c8d9618-576e-4039-bda7-49e6ffe1bedb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:25.633810 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1a238201-f72a-4069-8c21-4960e21997f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 200 len: 38317 microversion: 2.1 time: 0.142049 Nov 02 16:49:25.633968 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8c8d9618-576e-4039-bda7-49e6ffe1bedb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:25.634916 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 263/508] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:25 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 38317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:25.648414 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-65bd1b41-821c-41d1-8b16-ed60c71ff56d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:25.652880 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-65bd1b41-821c-41d1-8b16-ed60c71ff56d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:25.667332 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-65bd1b41-821c-41d1-8b16-ed60c71ff56d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:25.673597 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-65bd1b41-821c-41d1-8b16-ed60c71ff56d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:25.674775 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-65bd1b41-821c-41d1-8b16-ed60c71ff56d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:25.675462 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-65bd1b41-821c-41d1-8b16-ed60c71ff56d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:25.733468 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-65bd1b41-821c-41d1-8b16-ed60c71ff56d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/ips" status: 200 len: 147 microversion: 2.1 time: 0.089481 Nov 02 16:49:25.735803 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 264/509] 10.222.0.118 () {58 vars in 1252 bytes} [Tue Nov 2 16:49:25 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/ips => generated 147 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:49:25.789081 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-8c8d9618-576e-4039-bda7-49e6ffe1bedb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:25.804474 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-8c8d9618-576e-4039-bda7-49e6ffe1bedb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1318 microversion: 2.1 time: 0.201269 Nov 02 16:49:25.808616 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 246/510] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:25 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:26.089404 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0ab7a32c-b035-419a-b55e-49ff6edaac5a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:26.093626 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0ab7a32c-b035-419a-b55e-49ff6edaac5a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:26.161785 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0ab7a32c-b035-419a-b55e-49ff6edaac5a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:26.162593 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0ab7a32c-b035-419a-b55e-49ff6edaac5a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:26.164107 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0ab7a32c-b035-419a-b55e-49ff6edaac5a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:26.174646 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0ab7a32c-b035-419a-b55e-49ff6edaac5a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:26.486102 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-863c3a1f-4247-41cf-9663-baf4a313256b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:26.488654 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-863c3a1f-4247-41cf-9663-baf4a313256b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:26.506469 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-863c3a1f-4247-41cf-9663-baf4a313256b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:26.508846 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-863c3a1f-4247-41cf-9663-baf4a313256b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:26.510633 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-863c3a1f-4247-41cf-9663-baf4a313256b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:26.512704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-863c3a1f-4247-41cf-9663-baf4a313256b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:26.842868 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-863c3a1f-4247-41cf-9663-baf4a313256b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:26.853193 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-863c3a1f-4247-41cf-9663-baf4a313256b tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1571 microversion: 2.1 time: 0.372828 Nov 02 16:49:26.854067 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 247/511] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:26 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1571 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:26.861524 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2cfa7822-0380-416b-b1d4-6bb5d3c79cc0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:26.862178 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2cfa7822-0380-416b-b1d4-6bb5d3c79cc0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:26.870450 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2cfa7822-0380-416b-b1d4-6bb5d3c79cc0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:26.871253 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2cfa7822-0380-416b-b1d4-6bb5d3c79cc0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:26.872093 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2cfa7822-0380-416b-b1d4-6bb5d3c79cc0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:26.872659 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2cfa7822-0380-416b-b1d4-6bb5d3c79cc0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:27.115837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2cfa7822-0380-416b-b1d4-6bb5d3c79cc0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:27.125564 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2cfa7822-0380-416b-b1d4-6bb5d3c79cc0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1360 microversion: 2.1 time: 0.269527 Nov 02 16:49:27.130964 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 248/512] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:26 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1360 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:27.875155 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f716b92e-1cc6-4fab-baa5-ffc6b51ca0e5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:27.880902 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f716b92e-1cc6-4fab-baa5-ffc6b51ca0e5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:27.905800 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f716b92e-1cc6-4fab-baa5-ffc6b51ca0e5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:27.909324 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f716b92e-1cc6-4fab-baa5-ffc6b51ca0e5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:27.911363 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f716b92e-1cc6-4fab-baa5-ffc6b51ca0e5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:27.911958 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f716b92e-1cc6-4fab-baa5-ffc6b51ca0e5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:28.115247 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f716b92e-1cc6-4fab-baa5-ffc6b51ca0e5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:28.127157 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f716b92e-1cc6-4fab-baa5-ffc6b51ca0e5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1571 microversion: 2.1 time: 0.256523 Nov 02 16:49:28.128208 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 249/513] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:27 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1571 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:49:28.144963 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5dc73b23-8929-48b7-927f-f100b9e6995c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:28.145795 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5dc73b23-8929-48b7-927f-f100b9e6995c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:28.153299 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5dc73b23-8929-48b7-927f-f100b9e6995c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:28.154173 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5dc73b23-8929-48b7-927f-f100b9e6995c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:28.155608 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5dc73b23-8929-48b7-927f-f100b9e6995c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:28.156443 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5dc73b23-8929-48b7-927f-f100b9e6995c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:28.360951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5dc73b23-8929-48b7-927f-f100b9e6995c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:28.369470 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5dc73b23-8929-48b7-927f-f100b9e6995c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1360 microversion: 2.1 time: 0.228755 Nov 02 16:49:28.371440 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 250/514] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:28 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1360 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:49:28.951388 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4f68ff84-497d-467b-88a8-2c0362931fd2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78638461-a0b9-4c3b-95a6-af8c5c1d39e4"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:28.954480 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4f68ff84-497d-467b-88a8-2c0362931fd2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:28.963406 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4f68ff84-497d-467b-88a8-2c0362931fd2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:28.963893 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4f68ff84-497d-467b-88a8-2c0362931fd2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:28.964806 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4f68ff84-497d-467b-88a8-2c0362931fd2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:28.965446 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4f68ff84-497d-467b-88a8-2c0362931fd2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:42.420059 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0ab7a32c-b035-419a-b55e-49ff6edaac5a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 200 len: 38253 microversion: 2.20 time: 16.359333 Nov 02 16:49:42.421477 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 265/515] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:26 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 38253 bytes in 16362 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:42.428118 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2741931d-9941-4e92-841b-6abbdfd3dddd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:42.428890 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2741931d-9941-4e92-841b-6abbdfd3dddd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:42.457693 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2741931d-9941-4e92-841b-6abbdfd3dddd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:42.462548 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2741931d-9941-4e92-841b-6abbdfd3dddd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:42.463482 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2741931d-9941-4e92-841b-6abbdfd3dddd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:42.463950 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2741931d-9941-4e92-841b-6abbdfd3dddd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:42.689722 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4f68ff84-497d-467b-88a8-2c0362931fd2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.746159 Nov 02 16:49:42.691870 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 251/516] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:49:28 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/os-volume_attachments => generated 194 bytes in 13751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:49:42.725503 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1a4226e8-9d5e-410b-9e73-e51f92f343e1 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:42.733774 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1a4226e8-9d5e-410b-9e73-e51f92f343e1 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:42.750996 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1a4226e8-9d5e-410b-9e73-e51f92f343e1 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:42.752982 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1a4226e8-9d5e-410b-9e73-e51f92f343e1 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:42.761398 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1a4226e8-9d5e-410b-9e73-e51f92f343e1 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:42.761871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1a4226e8-9d5e-410b-9e73-e51f92f343e1 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:42.845483 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2741931d-9941-4e92-841b-6abbdfd3dddd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:42.866277 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2741931d-9941-4e92-841b-6abbdfd3dddd tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1571 microversion: 2.1 time: 0.443802 Nov 02 16:49:42.868278 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 266/517] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:42 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1571 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:42.873372 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4ec08a80-0e0b-4376-a493-06d0132fbf82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:42.873891 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4ec08a80-0e0b-4376-a493-06d0132fbf82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:42.881615 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ec08a80-0e0b-4376-a493-06d0132fbf82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:42.882187 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ec08a80-0e0b-4376-a493-06d0132fbf82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:42.883075 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ec08a80-0e0b-4376-a493-06d0132fbf82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:42.883757 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ec08a80-0e0b-4376-a493-06d0132fbf82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:42.930599 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4ec08a80-0e0b-4376-a493-06d0132fbf82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/ips" status: 200 len: 151 microversion: 2.20 time: 0.060719 Nov 02 16:49:42.931387 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 267/518] 10.222.0.118 () {60 vars in 1293 bytes} [Tue Nov 2 16:49:42 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/ips => generated 151 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:49:43.245695 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1a4226e8-9d5e-410b-9e73-e51f92f343e1 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:43.256501 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1a4226e8-9d5e-410b-9e73-e51f92f343e1 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1360 microversion: 2.1 time: 0.562382 Nov 02 16:49:43.257631 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 252/519] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:42 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1360 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:43.551864 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-5328a1dd-befd-477f-b0c1-e9c7a9512f4f req-dc94579a-6f67-4a8b-a84c-6d724ab2e154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd91cbf0-2d7e-4a11-9073-6e61ccfc7295", "tag": "dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:43.555194 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:49:43.555194 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:49:43.592809 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-5328a1dd-befd-477f-b0c1-e9c7a9512f4f req-dc94579a-6f67-4a8b-a84c-6d724ab2e154 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:43.593940 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-5328a1dd-befd-477f-b0c1-e9c7a9512f4f req-dc94579a-6f67-4a8b-a84c-6d724ab2e154 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:43.617628 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-5328a1dd-befd-477f-b0c1-e9c7a9512f4f req-dc94579a-6f67-4a8b-a84c-6d724ab2e154 service nova] Creating event network-changed:dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e for instance fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 on hv-cinder-77387 Nov 02 16:49:43.646893 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-5328a1dd-befd-477f-b0c1-e9c7a9512f4f req-dc94579a-6f67-4a8b-a84c-6d724ab2e154 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105540 Nov 02 16:49:43.649209 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 268/520] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:49:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:49:43.891762 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b59db782-fc21-4abc-881a-8a1eb66bc036 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:43.907442 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b59db782-fc21-4abc-881a-8a1eb66bc036 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:43.942921 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b59db782-fc21-4abc-881a-8a1eb66bc036 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:43.943744 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b59db782-fc21-4abc-881a-8a1eb66bc036 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:43.945218 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b59db782-fc21-4abc-881a-8a1eb66bc036 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:43.945978 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b59db782-fc21-4abc-881a-8a1eb66bc036 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:44.287177 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-933508c2-1c47-46de-8daa-3ae5c4312af7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:44.291441 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-933508c2-1c47-46de-8daa-3ae5c4312af7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:44.331746 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-933508c2-1c47-46de-8daa-3ae5c4312af7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:44.333875 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-933508c2-1c47-46de-8daa-3ae5c4312af7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:44.338977 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-933508c2-1c47-46de-8daa-3ae5c4312af7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:44.339779 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-933508c2-1c47-46de-8daa-3ae5c4312af7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:44.536928 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-933508c2-1c47-46de-8daa-3ae5c4312af7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:44.546034 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b59db782-fc21-4abc-881a-8a1eb66bc036 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:44.548427 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-933508c2-1c47-46de-8daa-3ae5c4312af7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1360 microversion: 2.1 time: 0.276505 Nov 02 16:49:44.558621 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 269/521] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:44 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1360 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:44.560899 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b59db782-fc21-4abc-881a-8a1eb66bc036 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1571 microversion: 2.1 time: 0.680279 Nov 02 16:49:44.561567 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 253/522] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:43 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1571 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:49:44.852373 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3cb4bc3b-5225-4df6-876d-d80784361f4d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:44.852868 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3cb4bc3b-5225-4df6-876d-d80784361f4d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:44.861244 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3cb4bc3b-5225-4df6-876d-d80784361f4d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:44.861692 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3cb4bc3b-5225-4df6-876d-d80784361f4d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:44.862774 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3cb4bc3b-5225-4df6-876d-d80784361f4d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:44.863220 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3cb4bc3b-5225-4df6-876d-d80784361f4d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:44.993874 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-3cb4bc3b-5225-4df6-876d-d80784361f4d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lazy-loading 'services' on Instance uuid 62a4ae9f-e986-4bf1-b110-04ccb11fa669 {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:49:45.096075 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3cb4bc3b-5225-4df6-876d-d80784361f4d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "DELETE /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments/d7679362-afa7-4e85-882d-c426683486e8" status: 202 len: 0 microversion: 2.1 time: 0.249066 Nov 02 16:49:45.097408 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 270/523] 10.222.0.118 () {58 vars in 1420 bytes} [Tue Nov 2 16:49:44 2021] DELETE /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments/d7679362-afa7-4e85-882d-c426683486e8 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:49:45.112436 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c614690a-e664-4751-85c2-9b4166725fbe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:45.114199 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c614690a-e664-4751-85c2-9b4166725fbe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:45.141552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c614690a-e664-4751-85c2-9b4166725fbe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:45.141552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c614690a-e664-4751-85c2-9b4166725fbe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:45.141552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c614690a-e664-4751-85c2-9b4166725fbe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:45.141552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c614690a-e664-4751-85c2-9b4166725fbe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:45.205873 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c614690a-e664-4751-85c2-9b4166725fbe tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101163 Nov 02 16:49:45.206873 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 254/524] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:49:45 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:49:45.569301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4297697f-37ac-426d-a731-913479a2a11b tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:45.570188 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4297697f-37ac-426d-a731-913479a2a11b tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:45.577991 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4297697f-37ac-426d-a731-913479a2a11b tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:45.578443 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4297697f-37ac-426d-a731-913479a2a11b tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:45.579302 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4297697f-37ac-426d-a731-913479a2a11b tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:45.579755 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4297697f-37ac-426d-a731-913479a2a11b tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:45.580766 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a1d4ad3b-7d60-4607-aa47-daff9e93e9e2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:45.581704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a1d4ad3b-7d60-4607-aa47-daff9e93e9e2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:45.589671 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a1d4ad3b-7d60-4607-aa47-daff9e93e9e2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:45.590126 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a1d4ad3b-7d60-4607-aa47-daff9e93e9e2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:45.591163 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a1d4ad3b-7d60-4607-aa47-daff9e93e9e2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:45.591846 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a1d4ad3b-7d60-4607-aa47-daff9e93e9e2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:45.803285 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-4297697f-37ac-426d-a731-913479a2a11b tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:45.817416 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4297697f-37ac-426d-a731-913479a2a11b tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1360 microversion: 2.1 time: 0.253972 Nov 02 16:49:45.819419 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 271/525] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:45 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1360 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:45.820688 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a1d4ad3b-7d60-4607-aa47-daff9e93e9e2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:45.837974 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a1d4ad3b-7d60-4607-aa47-daff9e93e9e2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1571 microversion: 2.1 time: 0.261877 Nov 02 16:49:45.839013 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 255/526] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:45 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1571 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:46.201382 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-800ad810-d000-49d8-beed-3e9e65d0aa9e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:46.202127 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-800ad810-d000-49d8-beed-3e9e65d0aa9e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:46.211295 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-800ad810-d000-49d8-beed-3e9e65d0aa9e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:46.211976 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-800ad810-d000-49d8-beed-3e9e65d0aa9e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:46.213504 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-800ad810-d000-49d8-beed-3e9e65d0aa9e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:46.214140 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-800ad810-d000-49d8-beed-3e9e65d0aa9e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:46.225628 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e8bb7c7b-3faa-4013-a449-696419780881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:46.226703 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e8bb7c7b-3faa-4013-a449-696419780881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:46.244801 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e8bb7c7b-3faa-4013-a449-696419780881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:46.244801 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e8bb7c7b-3faa-4013-a449-696419780881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:46.244801 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e8bb7c7b-3faa-4013-a449-696419780881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:46.253675 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e8bb7c7b-3faa-4013-a449-696419780881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:46.283568 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-800ad810-d000-49d8-beed-3e9e65d0aa9e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lazy-loading 'flavor' on Instance uuid 3df0bde8-504d-42f2-b162-1fb601b26528 {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:49:46.300965 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e8bb7c7b-3faa-4013-a449-696419780881 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082245 Nov 02 16:49:46.301831 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 256/527] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:49:46 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:49:46.642155 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-800ad810-d000-49d8-beed-3e9e65d0aa9e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 202 len: 0 microversion: 2.20 time: 0.445230 Nov 02 16:49:46.643181 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 272/528] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:49:46 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:49:46.652155 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f7ceddfc-c758-4509-bb80-c4d5c0154ef0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:46.653143 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f7ceddfc-c758-4509-bb80-c4d5c0154ef0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:46.660697 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f7ceddfc-c758-4509-bb80-c4d5c0154ef0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:46.661154 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f7ceddfc-c758-4509-bb80-c4d5c0154ef0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:46.662013 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f7ceddfc-c758-4509-bb80-c4d5c0154ef0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:46.662472 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f7ceddfc-c758-4509-bb80-c4d5c0154ef0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:46.835663 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f7ceddfc-c758-4509-bb80-c4d5c0154ef0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:46.839098 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-02b81b0f-9621-4777-a1e6-4881e40a8809 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:46.839949 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-02b81b0f-9621-4777-a1e6-4881e40a8809 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:46.846795 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f7ceddfc-c758-4509-bb80-c4d5c0154ef0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:46.848517 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-02b81b0f-9621-4777-a1e6-4881e40a8809 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:46.848944 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f7ceddfc-c758-4509-bb80-c4d5c0154ef0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:46.850459 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-02b81b0f-9621-4777-a1e6-4881e40a8809 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:46.850459 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-02b81b0f-9621-4777-a1e6-4881e40a8809 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:46.850459 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-02b81b0f-9621-4777-a1e6-4881e40a8809 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:46.853288 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f7ceddfc-c758-4509-bb80-c4d5c0154ef0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.202509 Nov 02 16:49:46.853288 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 257/529] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:49:46 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:49:46.856442 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7a065c45-7060-4ca3-bd01-3cb7bff08ae5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:46.857093 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7a065c45-7060-4ca3-bd01-3cb7bff08ae5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:46.865823 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7a065c45-7060-4ca3-bd01-3cb7bff08ae5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:46.866283 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7a065c45-7060-4ca3-bd01-3cb7bff08ae5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:46.867118 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7a065c45-7060-4ca3-bd01-3cb7bff08ae5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:46.867563 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7a065c45-7060-4ca3-bd01-3cb7bff08ae5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:47.033004 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-02b81b0f-9621-4777-a1e6-4881e40a8809 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:47.050077 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-02b81b0f-9621-4777-a1e6-4881e40a8809 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1360 microversion: 2.1 time: 0.215239 Nov 02 16:49:47.051514 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 273/530] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:46 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1360 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:47.052606 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7a065c45-7060-4ca3-bd01-3cb7bff08ae5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:47.062765 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7a065c45-7060-4ca3-bd01-3cb7bff08ae5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1571 microversion: 2.1 time: 0.209989 Nov 02 16:49:47.063430 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 258/531] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:46 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1571 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:47.314726 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3380ea42-3d17-42cd-92c5-86c648bb0ae3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:47.316574 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3380ea42-3d17-42cd-92c5-86c648bb0ae3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:47.329449 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3380ea42-3d17-42cd-92c5-86c648bb0ae3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:47.329921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3380ea42-3d17-42cd-92c5-86c648bb0ae3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:47.330766 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3380ea42-3d17-42cd-92c5-86c648bb0ae3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:47.331215 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3380ea42-3d17-42cd-92c5-86c648bb0ae3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:47.367222 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3380ea42-3d17-42cd-92c5-86c648bb0ae3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057371 Nov 02 16:49:47.367870 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 274/532] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:49:47 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:49:47.875636 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4ca563c0-3257-4fab-89c6-d2d583ba43b8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:47.877708 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4ca563c0-3257-4fab-89c6-d2d583ba43b8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:47.884295 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4ca563c0-3257-4fab-89c6-d2d583ba43b8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:47.884774 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4ca563c0-3257-4fab-89c6-d2d583ba43b8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:47.885835 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4ca563c0-3257-4fab-89c6-d2d583ba43b8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:47.886553 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4ca563c0-3257-4fab-89c6-d2d583ba43b8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:48.072639 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4ec9e044-c036-4048-ac9f-d0d3ca4d5e89 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:48.073499 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4ec9e044-c036-4048-ac9f-d0d3ca4d5e89 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:48.086674 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ec9e044-c036-4048-ac9f-d0d3ca4d5e89 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:48.087522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ec9e044-c036-4048-ac9f-d0d3ca4d5e89 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:48.089110 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ec9e044-c036-4048-ac9f-d0d3ca4d5e89 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:48.090002 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4ec9e044-c036-4048-ac9f-d0d3ca4d5e89 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:48.191788 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4ca563c0-3257-4fab-89c6-d2d583ba43b8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:48.205667 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4ca563c0-3257-4fab-89c6-d2d583ba43b8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:48.207283 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4ca563c0-3257-4fab-89c6-d2d583ba43b8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:48.208636 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4ca563c0-3257-4fab-89c6-d2d583ba43b8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.337589 Nov 02 16:49:48.220040 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 259/533] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:49:47 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:49:48.227390 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5388419d-b231-4662-ab15-e70efaea661d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:48.229060 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5388419d-b231-4662-ab15-e70efaea661d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:48.251036 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5388419d-b231-4662-ab15-e70efaea661d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:48.251936 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5388419d-b231-4662-ab15-e70efaea661d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:48.253557 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5388419d-b231-4662-ab15-e70efaea661d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:48.254387 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5388419d-b231-4662-ab15-e70efaea661d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:48.280446 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-4ec9e044-c036-4048-ac9f-d0d3ca4d5e89 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:48.289818 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4ec9e044-c036-4048-ac9f-d0d3ca4d5e89 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1360 microversion: 2.1 time: 0.224403 Nov 02 16:49:48.290907 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 275/534] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:48 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1360 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:48.382518 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-78409b1e-fa0b-4278-9d43-1d220e7b54b5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:48.386353 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-78409b1e-fa0b-4278-9d43-1d220e7b54b5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:48.396908 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78409b1e-fa0b-4278-9d43-1d220e7b54b5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:48.397371 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78409b1e-fa0b-4278-9d43-1d220e7b54b5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:48.398480 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78409b1e-fa0b-4278-9d43-1d220e7b54b5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:48.399068 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78409b1e-fa0b-4278-9d43-1d220e7b54b5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:48.445866 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-78409b1e-fa0b-4278-9d43-1d220e7b54b5 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068641 Nov 02 16:49:48.446533 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 276/535] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:49:48 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:49:48.521376 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5388419d-b231-4662-ab15-e70efaea661d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:48.533091 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5388419d-b231-4662-ab15-e70efaea661d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1571 microversion: 2.1 time: 0.313185 Nov 02 16:49:48.533764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 260/536] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:48 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1571 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:49.227995 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a0f2cbd2-d397-478d-ab1d-48d50977623f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:49.228721 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a0f2cbd2-d397-478d-ab1d-48d50977623f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:49.239151 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0f2cbd2-d397-478d-ab1d-48d50977623f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:49.239979 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0f2cbd2-d397-478d-ab1d-48d50977623f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:49.241057 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0f2cbd2-d397-478d-ab1d-48d50977623f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:49.241498 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0f2cbd2-d397-478d-ab1d-48d50977623f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:49.309094 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3ffa2e0c-87e9-4120-ad4a-f762eaf11ca4 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:49.310385 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3ffa2e0c-87e9-4120-ad4a-f762eaf11ca4 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:49.319328 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3ffa2e0c-87e9-4120-ad4a-f762eaf11ca4 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:49.319803 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3ffa2e0c-87e9-4120-ad4a-f762eaf11ca4 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:49.320978 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3ffa2e0c-87e9-4120-ad4a-f762eaf11ca4 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:49.321431 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3ffa2e0c-87e9-4120-ad4a-f762eaf11ca4 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:49.463238 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a0f2cbd2-d397-478d-ab1d-48d50977623f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:49.483069 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a0f2cbd2-d397-478d-ab1d-48d50977623f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:49.485715 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a0f2cbd2-d397-478d-ab1d-48d50977623f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:49.487477 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a0f2cbd2-d397-478d-ab1d-48d50977623f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.263641 Nov 02 16:49:49.499574 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 277/537] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:49:49 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:49:49.521451 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-030ee2a1-70e6-461f-ad71-3b1ac7f0ca5b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:49.523726 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-030ee2a1-70e6-461f-ad71-3b1ac7f0ca5b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:49.533660 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-030ee2a1-70e6-461f-ad71-3b1ac7f0ca5b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:49.534649 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-030ee2a1-70e6-461f-ad71-3b1ac7f0ca5b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:49.535773 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-030ee2a1-70e6-461f-ad71-3b1ac7f0ca5b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:49.536487 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-030ee2a1-70e6-461f-ad71-3b1ac7f0ca5b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:49.596949 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-030ee2a1-70e6-461f-ad71-3b1ac7f0ca5b tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094784 Nov 02 16:49:49.598088 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 278/538] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:49:49 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:49:49.603225 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a0cae51c-699f-474d-8ab7-bd4de1bac104 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:49.606672 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3ffa2e0c-87e9-4120-ad4a-f762eaf11ca4 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:49.609249 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a0cae51c-699f-474d-8ab7-bd4de1bac104 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:49.619295 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0cae51c-699f-474d-8ab7-bd4de1bac104 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:49.621794 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0cae51c-699f-474d-8ab7-bd4de1bac104 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:49.622390 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3ffa2e0c-87e9-4120-ad4a-f762eaf11ca4 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1360 microversion: 2.1 time: 0.317783 Nov 02 16:49:49.623285 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0cae51c-699f-474d-8ab7-bd4de1bac104 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:49.625163 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0cae51c-699f-474d-8ab7-bd4de1bac104 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:49.635456 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 261/539] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:49 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1360 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:49:49.833523 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a0cae51c-699f-474d-8ab7-bd4de1bac104 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:49.844711 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a0cae51c-699f-474d-8ab7-bd4de1bac104 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1571 microversion: 2.1 time: 0.245128 Nov 02 16:49:49.845630 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 279/540] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:49 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1571 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:50.511400 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-58f6a592-e8b7-4762-ba1c-e492b21a1dcc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:50.517765 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-58f6a592-e8b7-4762-ba1c-e492b21a1dcc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:50.545933 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-58f6a592-e8b7-4762-ba1c-e492b21a1dcc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:50.547263 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-58f6a592-e8b7-4762-ba1c-e492b21a1dcc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:50.548224 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-58f6a592-e8b7-4762-ba1c-e492b21a1dcc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:50.548681 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-58f6a592-e8b7-4762-ba1c-e492b21a1dcc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:50.614246 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-785c7d68-1b03-4698-beab-5f02a57827ed tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:50.616279 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-785c7d68-1b03-4698-beab-5f02a57827ed tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:50.626118 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-785c7d68-1b03-4698-beab-5f02a57827ed tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:50.627014 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-785c7d68-1b03-4698-beab-5f02a57827ed tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:50.628981 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-785c7d68-1b03-4698-beab-5f02a57827ed tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:50.629458 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-785c7d68-1b03-4698-beab-5f02a57827ed tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:50.676826 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-785c7d68-1b03-4698-beab-5f02a57827ed tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068106 Nov 02 16:49:50.681689 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 280/541] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:49:50 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:49:50.689145 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ab868f98-55a2-4fda-af46-5c8e9c18b613 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:50.690815 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ab868f98-55a2-4fda-af46-5c8e9c18b613 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:50.724752 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ab868f98-55a2-4fda-af46-5c8e9c18b613 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:50.725358 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ab868f98-55a2-4fda-af46-5c8e9c18b613 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:50.726337 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ab868f98-55a2-4fda-af46-5c8e9c18b613 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:50.726880 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ab868f98-55a2-4fda-af46-5c8e9c18b613 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:50.758407 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-58f6a592-e8b7-4762-ba1c-e492b21a1dcc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:50.772686 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-58f6a592-e8b7-4762-ba1c-e492b21a1dcc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:50.774505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-58f6a592-e8b7-4762-ba1c-e492b21a1dcc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:50.775917 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-58f6a592-e8b7-4762-ba1c-e492b21a1dcc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.272583 Nov 02 16:49:50.776614 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 262/542] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:49:50 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:49:50.864226 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f22a0650-4d04-411a-953e-ce2a5dbcacaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:50.865097 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f22a0650-4d04-411a-953e-ce2a5dbcacaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:50.873406 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f22a0650-4d04-411a-953e-ce2a5dbcacaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:50.873854 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f22a0650-4d04-411a-953e-ce2a5dbcacaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:50.875121 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f22a0650-4d04-411a-953e-ce2a5dbcacaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:50.876081 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f22a0650-4d04-411a-953e-ce2a5dbcacaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:50.902224 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ab868f98-55a2-4fda-af46-5c8e9c18b613 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:50.912009 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ab868f98-55a2-4fda-af46-5c8e9c18b613 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1360 microversion: 2.1 time: 0.231530 Nov 02 16:49:50.913284 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 281/543] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:50 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1360 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:51.051571 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f22a0650-4d04-411a-953e-ce2a5dbcacaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:51.062411 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f22a0650-4d04-411a-953e-ce2a5dbcacaa tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1571 microversion: 2.1 time: 0.202717 Nov 02 16:49:51.064010 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 263/544] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:50 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1571 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:49:51.675315 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5139e372-f94f-43ab-96b1-67c4771e13a9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:51.684618 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5139e372-f94f-43ab-96b1-67c4771e13a9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:51.684618 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5139e372-f94f-43ab-96b1-67c4771e13a9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:51.693501 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7eaa4c73-09ff-4df1-bf5a-458170d8e718 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:51.695205 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7eaa4c73-09ff-4df1-bf5a-458170d8e718 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:51.706715 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7eaa4c73-09ff-4df1-bf5a-458170d8e718 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:51.708026 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7eaa4c73-09ff-4df1-bf5a-458170d8e718 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:51.709598 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7eaa4c73-09ff-4df1-bf5a-458170d8e718 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:51.710910 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7eaa4c73-09ff-4df1-bf5a-458170d8e718 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:51.758594 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5139e372-f94f-43ab-96b1-67c4771e13a9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Going to try to stop instance {{(pid=127649) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Nov 02 16:49:51.772533 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7eaa4c73-09ff-4df1-bf5a-458170d8e718 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085000 Nov 02 16:49:51.782613 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 264/545] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:49:51 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:49:51.804794 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3661f6af-49a7-4028-be88-ef97e2a00fa2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:51.806215 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3661f6af-49a7-4028-be88-ef97e2a00fa2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:51.816151 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3661f6af-49a7-4028-be88-ef97e2a00fa2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:51.816867 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3661f6af-49a7-4028-be88-ef97e2a00fa2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:51.818256 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3661f6af-49a7-4028-be88-ef97e2a00fa2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:51.818795 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3661f6af-49a7-4028-be88-ef97e2a00fa2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:51.832870 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5139e372-f94f-43ab-96b1-67c4771e13a9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 202 len: 0 microversion: 2.1 time: 0.161555 Nov 02 16:49:51.838087 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 282/546] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:51 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:51.845366 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c8264522-56d3-491e-a2be-86d60006335e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:51.846589 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c8264522-56d3-491e-a2be-86d60006335e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:51.855097 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c8264522-56d3-491e-a2be-86d60006335e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:51.855965 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c8264522-56d3-491e-a2be-86d60006335e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:51.857099 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c8264522-56d3-491e-a2be-86d60006335e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:51.857802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c8264522-56d3-491e-a2be-86d60006335e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:52.050914 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3661f6af-49a7-4028-be88-ef97e2a00fa2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:52.067327 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c8264522-56d3-491e-a2be-86d60006335e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:52.069413 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3661f6af-49a7-4028-be88-ef97e2a00fa2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:52.073024 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3661f6af-49a7-4028-be88-ef97e2a00fa2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:52.075378 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3661f6af-49a7-4028-be88-ef97e2a00fa2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.280660 Nov 02 16:49:52.076561 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 265/547] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:49:51 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:49:52.079764 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c8264522-56d3-491e-a2be-86d60006335e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.239578 Nov 02 16:49:52.090557 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5e26d0c7-1357-4f1f-b34a-29d7df9b8eab tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:52.092566 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 283/548] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:51 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:52.093309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5e26d0c7-1357-4f1f-b34a-29d7df9b8eab tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:52.099033 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2bbdae43-0342-4007-bafc-975fe95eb05c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:52.100047 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2bbdae43-0342-4007-bafc-975fe95eb05c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:52.106023 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5e26d0c7-1357-4f1f-b34a-29d7df9b8eab tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:52.106980 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5e26d0c7-1357-4f1f-b34a-29d7df9b8eab tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:52.109423 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5e26d0c7-1357-4f1f-b34a-29d7df9b8eab tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:52.110289 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5e26d0c7-1357-4f1f-b34a-29d7df9b8eab tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:52.116624 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2bbdae43-0342-4007-bafc-975fe95eb05c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:52.117336 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2bbdae43-0342-4007-bafc-975fe95eb05c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:52.118517 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2bbdae43-0342-4007-bafc-975fe95eb05c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:52.119443 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2bbdae43-0342-4007-bafc-975fe95eb05c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:52.355355 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5e26d0c7-1357-4f1f-b34a-29d7df9b8eab tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:52.364665 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5e26d0c7-1357-4f1f-b34a-29d7df9b8eab tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1360 microversion: 2.1 time: 0.286208 Nov 02 16:49:52.374420 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 266/549] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:52 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1360 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:52.425223 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2bbdae43-0342-4007-bafc-975fe95eb05c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:52.436101 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2bbdae43-0342-4007-bafc-975fe95eb05c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1551 microversion: 2.1 time: 0.341209 Nov 02 16:49:52.436895 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 284/550] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:52 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1551 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:52.458261 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-74d9116b-9f64-4974-8d25-929de1f43fc7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:52.458802 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-74d9116b-9f64-4974-8d25-929de1f43fc7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:52.465526 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-74d9116b-9f64-4974-8d25-929de1f43fc7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:52.466006 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-74d9116b-9f64-4974-8d25-929de1f43fc7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:52.466848 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-74d9116b-9f64-4974-8d25-929de1f43fc7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:52.467306 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-74d9116b-9f64-4974-8d25-929de1f43fc7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:52.579127 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-74d9116b-9f64-4974-8d25-929de1f43fc7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] HTTP exception thrown: Cannot 'detach_volume' instance 6e5b406e-d37d-44b0-bb2f-39532baf3f9e while it is in vm_state rescued Nov 02 16:49:52.579885 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-74d9116b-9f64-4974-8d25-929de1f43fc7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Returning 409 to user: Cannot 'detach_volume' instance 6e5b406e-d37d-44b0-bb2f-39532baf3f9e while it is in vm_state rescued {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:49:52.581022 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-74d9116b-9f64-4974-8d25-929de1f43fc7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "DELETE /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments/431aaf37-701b-4ec1-a365-72ff60d64d09" status: 409 len: 152 microversion: 2.1 time: 0.127444 Nov 02 16:49:52.581731 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 267/551] 10.222.0.118 () {58 vars in 1420 bytes} [Tue Nov 2 16:49:52 2021] DELETE /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments/431aaf37-701b-4ec1-a365-72ff60d64d09 => generated 152 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 16:49:52.593532 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f63e9e35-7c78-400b-aaa4-d8e6bff63e32 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:52.594000 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f63e9e35-7c78-400b-aaa4-d8e6bff63e32 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:52.602507 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f63e9e35-7c78-400b-aaa4-d8e6bff63e32 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:52.603072 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f63e9e35-7c78-400b-aaa4-d8e6bff63e32 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:52.604139 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f63e9e35-7c78-400b-aaa4-d8e6bff63e32 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:52.604761 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f63e9e35-7c78-400b-aaa4-d8e6bff63e32 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:52.706691 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f63e9e35-7c78-400b-aaa4-d8e6bff63e32 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "POST /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/action" status: 202 len: 0 microversion: 2.1 time: 0.117961 Nov 02 16:49:52.712634 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 285/552] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:49:52 2021] POST /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:49:52.721547 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6108124e-da0f-4321-ab59-c72aacff67e8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:52.722268 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6108124e-da0f-4321-ab59-c72aacff67e8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:52.740382 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6108124e-da0f-4321-ab59-c72aacff67e8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:52.741312 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6108124e-da0f-4321-ab59-c72aacff67e8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:52.742164 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6108124e-da0f-4321-ab59-c72aacff67e8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:52.742617 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6108124e-da0f-4321-ab59-c72aacff67e8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:52.791281 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4d21b0ec-5bed-4c69-92ca-a981d15d9c66 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:52.792950 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4d21b0ec-5bed-4c69-92ca-a981d15d9c66 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:52.801770 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4d21b0ec-5bed-4c69-92ca-a981d15d9c66 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:52.802384 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4d21b0ec-5bed-4c69-92ca-a981d15d9c66 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:52.803325 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4d21b0ec-5bed-4c69-92ca-a981d15d9c66 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:52.803861 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4d21b0ec-5bed-4c69-92ca-a981d15d9c66 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:52.842352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4d21b0ec-5bed-4c69-92ca-a981d15d9c66 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055689 Nov 02 16:49:52.848476 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 286/553] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:49:52 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 16:49:53.033881 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-5002095e-db74-46fe-a125-42174e9025d4 req-408564a6-ca85-4469-9107-9d38fb1387e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd91cbf0-2d7e-4a11-9073-6e61ccfc7295", "name": "network-vif-plugged", "status": "completed", "tag": "dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:53.036935 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:49:53.036935 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:49:53.058440 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6108124e-da0f-4321-ab59-c72aacff67e8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:53.069832 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6108124e-da0f-4321-ab59-c72aacff67e8 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1559 microversion: 2.1 time: 0.353682 Nov 02 16:49:53.070758 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 268/554] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:52 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1559 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:53.081539 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-5002095e-db74-46fe-a125-42174e9025d4 req-408564a6-ca85-4469-9107-9d38fb1387e2 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:53.081539 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-5002095e-db74-46fe-a125-42174e9025d4 req-408564a6-ca85-4469-9107-9d38fb1387e2 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:53.102954 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9b0eb576-5888-487b-b9fd-7f983b80e62a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:53.104043 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9b0eb576-5888-487b-b9fd-7f983b80e62a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:53.113784 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9b0eb576-5888-487b-b9fd-7f983b80e62a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:53.115126 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9b0eb576-5888-487b-b9fd-7f983b80e62a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:53.116424 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9b0eb576-5888-487b-b9fd-7f983b80e62a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:53.117158 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9b0eb576-5888-487b-b9fd-7f983b80e62a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:53.132515 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-5002095e-db74-46fe-a125-42174e9025d4 req-408564a6-ca85-4469-9107-9d38fb1387e2 service nova] Creating event network-vif-plugged:dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e for instance fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 on hv-cinder-77387 Nov 02 16:49:53.156403 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-5002095e-db74-46fe-a125-42174e9025d4 req-408564a6-ca85-4469-9107-9d38fb1387e2 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129575 Nov 02 16:49:53.160790 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 287/555] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:49:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:49:53.171155 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-58a4336c-b262-480a-bad5-87442e56899e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:53.171919 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-58a4336c-b262-480a-bad5-87442e56899e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:53.184943 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-58a4336c-b262-480a-bad5-87442e56899e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:53.185974 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-58a4336c-b262-480a-bad5-87442e56899e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:53.186992 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-58a4336c-b262-480a-bad5-87442e56899e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:53.190137 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-58a4336c-b262-480a-bad5-87442e56899e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:53.532131 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9b0eb576-5888-487b-b9fd-7f983b80e62a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:53.533680 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-58a4336c-b262-480a-bad5-87442e56899e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:53.545263 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9b0eb576-5888-487b-b9fd-7f983b80e62a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.449158 Nov 02 16:49:53.547291 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 269/556] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:53 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:49:53.553970 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4248a3bb-e1f0-4571-8f1b-c5a43dcb3eb5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:53.555621 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4248a3bb-e1f0-4571-8f1b-c5a43dcb3eb5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:53.569936 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4248a3bb-e1f0-4571-8f1b-c5a43dcb3eb5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:53.570425 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4248a3bb-e1f0-4571-8f1b-c5a43dcb3eb5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:53.571466 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4248a3bb-e1f0-4571-8f1b-c5a43dcb3eb5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:53.571647 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-58a4336c-b262-480a-bad5-87442e56899e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:53.571925 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4248a3bb-e1f0-4571-8f1b-c5a43dcb3eb5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:53.580455 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-58a4336c-b262-480a-bad5-87442e56899e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:53.583310 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-58a4336c-b262-480a-bad5-87442e56899e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.419811 Nov 02 16:49:53.583971 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 288/557] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:49:53 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:49:53.858305 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4248a3bb-e1f0-4571-8f1b-c5a43dcb3eb5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:53.867706 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4248a3bb-e1f0-4571-8f1b-c5a43dcb3eb5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1360 microversion: 2.1 time: 0.318525 Nov 02 16:49:53.868995 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 270/558] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:53 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1360 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:54.090416 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bdc92132-b48c-4ccc-8cad-233e5403615c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:54.091125 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-bdc92132-b48c-4ccc-8cad-233e5403615c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:54.107084 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bdc92132-b48c-4ccc-8cad-233e5403615c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:54.107555 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bdc92132-b48c-4ccc-8cad-233e5403615c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:54.109253 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bdc92132-b48c-4ccc-8cad-233e5403615c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:54.110723 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bdc92132-b48c-4ccc-8cad-233e5403615c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:54.188687 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2df4150b-f9b7-4a4f-94ee-0e84b5703885 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:54.189165 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2df4150b-f9b7-4a4f-94ee-0e84b5703885 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:54.197409 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2df4150b-f9b7-4a4f-94ee-0e84b5703885 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:54.197879 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2df4150b-f9b7-4a4f-94ee-0e84b5703885 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:54.199078 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2df4150b-f9b7-4a4f-94ee-0e84b5703885 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:54.199542 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2df4150b-f9b7-4a4f-94ee-0e84b5703885 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:54.232619 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2df4150b-f9b7-4a4f-94ee-0e84b5703885 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Going to try to terminate instance {{(pid=127648) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:49:54.306179 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-bdc92132-b48c-4ccc-8cad-233e5403615c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:54.322538 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-bdc92132-b48c-4ccc-8cad-233e5403615c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1559 microversion: 2.1 time: 0.236431 Nov 02 16:49:54.324219 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 289/559] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:54 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1559 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:54.360094 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2df4150b-f9b7-4a4f-94ee-0e84b5703885 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "DELETE /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 204 len: 0 microversion: 2.1 time: 0.175303 Nov 02 16:49:54.360919 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 271/560] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:49:54 2021] DELETE /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:49:54.370053 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6d00bb17-ac5f-4150-847c-484a2650927e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:54.370701 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6d00bb17-ac5f-4150-847c-484a2650927e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:54.378834 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6d00bb17-ac5f-4150-847c-484a2650927e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:54.379335 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6d00bb17-ac5f-4150-847c-484a2650927e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:54.380198 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6d00bb17-ac5f-4150-847c-484a2650927e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:54.380664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6d00bb17-ac5f-4150-847c-484a2650927e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:54.530072 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6d00bb17-ac5f-4150-847c-484a2650927e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:54.539719 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6d00bb17-ac5f-4150-847c-484a2650927e tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1517 microversion: 2.1 time: 0.173901 Nov 02 16:49:54.540417 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 290/561] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:54 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:49:54.568911 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-699ad466-2c79-4dc7-bcf3-a624afe991c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:54.570039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-699ad466-2c79-4dc7-bcf3-a624afe991c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:54.577583 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-699ad466-2c79-4dc7-bcf3-a624afe991c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:54.578047 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-699ad466-2c79-4dc7-bcf3-a624afe991c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:54.578873 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-699ad466-2c79-4dc7-bcf3-a624afe991c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:54.579322 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-699ad466-2c79-4dc7-bcf3-a624afe991c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:54.602900 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0f0ff7aa-effb-4839-a03a-ae7fd54bc337 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:54.603778 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0f0ff7aa-effb-4839-a03a-ae7fd54bc337 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:54.611583 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0f0ff7aa-effb-4839-a03a-ae7fd54bc337 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:54.612071 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0f0ff7aa-effb-4839-a03a-ae7fd54bc337 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:54.612932 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0f0ff7aa-effb-4839-a03a-ae7fd54bc337 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:54.613419 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0f0ff7aa-effb-4839-a03a-ae7fd54bc337 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:54.744475 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-699ad466-2c79-4dc7-bcf3-a624afe991c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:54.757082 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-699ad466-2c79-4dc7-bcf3-a624afe991c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.192424 Nov 02 16:49:54.757769 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 272/562] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:54 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:54.784526 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0f0ff7aa-effb-4839-a03a-ae7fd54bc337 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:54.793675 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0f0ff7aa-effb-4839-a03a-ae7fd54bc337 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:54.795308 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0f0ff7aa-effb-4839-a03a-ae7fd54bc337 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:54.796664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0f0ff7aa-effb-4839-a03a-ae7fd54bc337 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.197951 Nov 02 16:49:54.797457 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 291/563] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:49:54 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:49:54.886871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-12086b50-e122-4d48-be8a-8933ed84ccd7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:54.887624 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-12086b50-e122-4d48-be8a-8933ed84ccd7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:54.896272 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-12086b50-e122-4d48-be8a-8933ed84ccd7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:54.896894 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-12086b50-e122-4d48-be8a-8933ed84ccd7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:54.897728 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-12086b50-e122-4d48-be8a-8933ed84ccd7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:54.898212 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-12086b50-e122-4d48-be8a-8933ed84ccd7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:55.054928 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-12086b50-e122-4d48-be8a-8933ed84ccd7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:55.063923 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-12086b50-e122-4d48-be8a-8933ed84ccd7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1360 microversion: 2.1 time: 0.181478 Nov 02 16:49:55.064636 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 273/564] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:54 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1360 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:55.342327 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ed753fea-b26e-4720-9580-8d41f95268d3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:55.343782 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ed753fea-b26e-4720-9580-8d41f95268d3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:55.352414 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ed753fea-b26e-4720-9580-8d41f95268d3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:55.352983 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ed753fea-b26e-4720-9580-8d41f95268d3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:55.353971 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ed753fea-b26e-4720-9580-8d41f95268d3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:55.354505 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ed753fea-b26e-4720-9580-8d41f95268d3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:55.559364 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-65c3942f-56bd-456d-9c9e-ad8cb72bcff3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:55.560019 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-65c3942f-56bd-456d-9c9e-ad8cb72bcff3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:55.561468 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ed753fea-b26e-4720-9580-8d41f95268d3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:55.568425 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-65c3942f-56bd-456d-9c9e-ad8cb72bcff3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:55.568891 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-65c3942f-56bd-456d-9c9e-ad8cb72bcff3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:55.569742 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-65c3942f-56bd-456d-9c9e-ad8cb72bcff3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:55.570190 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-65c3942f-56bd-456d-9c9e-ad8cb72bcff3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:55.572731 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ed753fea-b26e-4720-9580-8d41f95268d3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1559 microversion: 2.1 time: 0.234571 Nov 02 16:49:55.573508 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 292/565] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:55 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:55.726299 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-65c3942f-56bd-456d-9c9e-ad8cb72bcff3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:55.735503 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-65c3942f-56bd-456d-9c9e-ad8cb72bcff3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1517 microversion: 2.1 time: 0.180223 Nov 02 16:49:55.736143 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 274/566] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:55 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:55.778045 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3b1ca1d8-5800-4383-961a-03dac3a10091 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:55.778563 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3b1ca1d8-5800-4383-961a-03dac3a10091 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:55.785311 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3b1ca1d8-5800-4383-961a-03dac3a10091 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:55.785773 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3b1ca1d8-5800-4383-961a-03dac3a10091 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:55.786577 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3b1ca1d8-5800-4383-961a-03dac3a10091 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:55.787022 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3b1ca1d8-5800-4383-961a-03dac3a10091 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:55.816470 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-11a20c6f-b4ab-49f1-90bd-62c8f4f2d33a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:55.817119 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-11a20c6f-b4ab-49f1-90bd-62c8f4f2d33a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:55.828102 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-11a20c6f-b4ab-49f1-90bd-62c8f4f2d33a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:55.828795 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-11a20c6f-b4ab-49f1-90bd-62c8f4f2d33a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:55.829631 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-11a20c6f-b4ab-49f1-90bd-62c8f4f2d33a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:55.830086 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-11a20c6f-b4ab-49f1-90bd-62c8f4f2d33a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:55.954249 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3b1ca1d8-5800-4383-961a-03dac3a10091 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:55.963555 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3b1ca1d8-5800-4383-961a-03dac3a10091 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.189541 Nov 02 16:49:55.964537 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 293/567] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:55 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:56.004074 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-11a20c6f-b4ab-49f1-90bd-62c8f4f2d33a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:56.014383 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-11a20c6f-b4ab-49f1-90bd-62c8f4f2d33a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:56.016796 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-11a20c6f-b4ab-49f1-90bd-62c8f4f2d33a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:56.018298 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-11a20c6f-b4ab-49f1-90bd-62c8f4f2d33a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.206802 Nov 02 16:49:56.019133 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 275/568] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:49:55 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:49:56.082616 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3734cfce-9349-4f8b-a5a3-9ad97382a3e8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:56.083149 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3734cfce-9349-4f8b-a5a3-9ad97382a3e8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:56.091097 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3734cfce-9349-4f8b-a5a3-9ad97382a3e8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.091559 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3734cfce-9349-4f8b-a5a3-9ad97382a3e8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:56.092466 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3734cfce-9349-4f8b-a5a3-9ad97382a3e8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.092966 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3734cfce-9349-4f8b-a5a3-9ad97382a3e8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:56.246193 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3734cfce-9349-4f8b-a5a3-9ad97382a3e8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:56.255595 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3734cfce-9349-4f8b-a5a3-9ad97382a3e8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1551 microversion: 2.1 time: 0.177438 Nov 02 16:49:56.256246 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 294/569] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:56 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1551 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:56.273883 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3e1eecaa-9888-437c-8e87-b4fea141f797 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:56.274523 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3e1eecaa-9888-437c-8e87-b4fea141f797 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:56.281486 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3e1eecaa-9888-437c-8e87-b4fea141f797 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.281953 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3e1eecaa-9888-437c-8e87-b4fea141f797 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:56.282753 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3e1eecaa-9888-437c-8e87-b4fea141f797 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.283206 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3e1eecaa-9888-437c-8e87-b4fea141f797 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:56.429357 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3e1eecaa-9888-437c-8e87-b4fea141f797 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:56.437610 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3e1eecaa-9888-437c-8e87-b4fea141f797 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1551 microversion: 2.1 time: 0.167928 Nov 02 16:49:56.438236 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 276/570] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:56 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1551 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:56.454234 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f666d4fe-a5d0-45aa-b18e-ec6329a07ecb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:56.457807 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:49:56.457807 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:49:56.458857 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f666d4fe-a5d0-45aa-b18e-ec6329a07ecb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:56.459602 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f666d4fe-a5d0-45aa-b18e-ec6329a07ecb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Searching by: {'deleted': False, 'project_id': '078aa8372f994f1eafe3013d58d8c979'} {{(pid=127649) get_all /opt/stack/nova/nova/compute/api.py:2905}} Nov 02 16:49:56.467307 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f666d4fe-a5d0-45aa-b18e-ec6329a07ecb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.468458 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f666d4fe-a5d0-45aa-b18e-ec6329a07ecb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:56.469555 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f666d4fe-a5d0-45aa-b18e-ec6329a07ecb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.469997 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f666d4fe-a5d0-45aa-b18e-ec6329a07ecb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:56.567011 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.multi_cell_list [None req-f666d4fe-a5d0-45aa-b18e-ec6329a07ecb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127649) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 02 16:49:56.592023 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3051efc3-b48c-4b2c-98d7-38d6532725ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:56.593363 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3051efc3-b48c-4b2c-98d7-38d6532725ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:56.601170 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3051efc3-b48c-4b2c-98d7-38d6532725ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.601644 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3051efc3-b48c-4b2c-98d7-38d6532725ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:56.602541 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3051efc3-b48c-4b2c-98d7-38d6532725ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.602994 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3051efc3-b48c-4b2c-98d7-38d6532725ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:56.675398 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f666d4fe-a5d0-45aa-b18e-ec6329a07ecb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.224886 Nov 02 16:49:56.676456 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 295/571] 10.222.0.118 () {58 vars in 1129 bytes} [Tue Nov 2 16:49:56 2021] GET /compute/v2.1/servers => generated 342 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:49:56.687709 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3254a614-3529-4633-a1d8-9705dd132977 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:56.688382 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3254a614-3529-4633-a1d8-9705dd132977 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:56.694776 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3254a614-3529-4633-a1d8-9705dd132977 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.695235 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3254a614-3529-4633-a1d8-9705dd132977 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:56.696039 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3254a614-3529-4633-a1d8-9705dd132977 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.696518 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3254a614-3529-4633-a1d8-9705dd132977 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:56.761691 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3051efc3-b48c-4b2c-98d7-38d6532725ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:56.771686 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3051efc3-b48c-4b2c-98d7-38d6532725ea tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1559 microversion: 2.1 time: 0.184062 Nov 02 16:49:56.772715 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 277/572] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:56 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:56.782523 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d8c917e9-18fa-4ef9-be3a-b53852352df3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:56.782523 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d8c917e9-18fa-4ef9-be3a-b53852352df3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:56.789617 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d8c917e9-18fa-4ef9-be3a-b53852352df3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.790751 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d8c917e9-18fa-4ef9-be3a-b53852352df3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:56.791312 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d8c917e9-18fa-4ef9-be3a-b53852352df3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.792507 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d8c917e9-18fa-4ef9-be3a-b53852352df3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:56.853111 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3254a614-3529-4633-a1d8-9705dd132977 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:56.862609 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3254a614-3529-4633-a1d8-9705dd132977 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1551 microversion: 2.1 time: 0.178982 Nov 02 16:49:56.863289 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 296/573] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:56 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1551 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:49:56.945179 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d8c917e9-18fa-4ef9-be3a-b53852352df3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:56.954186 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d8c917e9-18fa-4ef9-be3a-b53852352df3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1517 microversion: 2.1 time: 0.177052 Nov 02 16:49:56.954823 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 278/574] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:56 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:56.982898 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a88a1298-680c-4449-89cd-0bca65b4d1c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:56.984249 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a88a1298-680c-4449-89cd-0bca65b4d1c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:56.990836 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a88a1298-680c-4449-89cd-0bca65b4d1c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.991299 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a88a1298-680c-4449-89cd-0bca65b4d1c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:56.992111 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a88a1298-680c-4449-89cd-0bca65b4d1c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:56.992613 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a88a1298-680c-4449-89cd-0bca65b4d1c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:57.038475 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3e44202f-a9f9-4cbe-9c29-ec979eef1a43 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:57.039309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3e44202f-a9f9-4cbe-9c29-ec979eef1a43 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:57.046555 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3e44202f-a9f9-4cbe-9c29-ec979eef1a43 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:57.047211 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3e44202f-a9f9-4cbe-9c29-ec979eef1a43 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:57.048303 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3e44202f-a9f9-4cbe-9c29-ec979eef1a43 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:57.049084 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3e44202f-a9f9-4cbe-9c29-ec979eef1a43 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:57.150915 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a88a1298-680c-4449-89cd-0bca65b4d1c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:57.170648 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a88a1298-680c-4449-89cd-0bca65b4d1c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.191743 Nov 02 16:49:57.172662 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 297/575] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:56 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:57.220318 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3e44202f-a9f9-4cbe-9c29-ec979eef1a43 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:57.230307 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3e44202f-a9f9-4cbe-9c29-ec979eef1a43 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:57.231883 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3e44202f-a9f9-4cbe-9c29-ec979eef1a43 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:57.233304 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3e44202f-a9f9-4cbe-9c29-ec979eef1a43 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.198937 Nov 02 16:49:57.234882 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 279/576] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:49:57 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:49:57.790454 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a0dd309e-8943-473c-86a0-5dded23d2f92 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:57.791211 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a0dd309e-8943-473c-86a0-5dded23d2f92 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:57.798160 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0dd309e-8943-473c-86a0-5dded23d2f92 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:57.798621 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0dd309e-8943-473c-86a0-5dded23d2f92 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:57.799411 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0dd309e-8943-473c-86a0-5dded23d2f92 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:57.799854 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0dd309e-8943-473c-86a0-5dded23d2f92 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:57.949430 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a0dd309e-8943-473c-86a0-5dded23d2f92 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:57.959674 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a0dd309e-8943-473c-86a0-5dded23d2f92 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1559 microversion: 2.1 time: 0.173170 Nov 02 16:49:57.960371 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 298/577] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:57 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:57.971762 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4f0bca12-775c-46a2-b987-32b37d2215f3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:57.972450 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4f0bca12-775c-46a2-b987-32b37d2215f3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:57.979880 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4f0bca12-775c-46a2-b987-32b37d2215f3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:57.980382 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4f0bca12-775c-46a2-b987-32b37d2215f3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:57.981210 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4f0bca12-775c-46a2-b987-32b37d2215f3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:57.981662 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4f0bca12-775c-46a2-b987-32b37d2215f3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:58.138506 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4f0bca12-775c-46a2-b987-32b37d2215f3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:58.148288 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4f0bca12-775c-46a2-b987-32b37d2215f3 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1517 microversion: 2.1 time: 0.181012 Nov 02 16:49:58.148930 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 280/578] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:57 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:58.190363 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f3f8a6bb-4da7-41be-8bdc-173c34f2632d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:58.191040 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f3f8a6bb-4da7-41be-8bdc-173c34f2632d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:58.198059 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f3f8a6bb-4da7-41be-8bdc-173c34f2632d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:58.198518 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f3f8a6bb-4da7-41be-8bdc-173c34f2632d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:58.199334 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f3f8a6bb-4da7-41be-8bdc-173c34f2632d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:58.199759 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f3f8a6bb-4da7-41be-8bdc-173c34f2632d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:58.252824 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-63e13c2b-ab6b-43fa-bbf7-6852030c73db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:58.253481 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-63e13c2b-ab6b-43fa-bbf7-6852030c73db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:58.260541 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-63e13c2b-ab6b-43fa-bbf7-6852030c73db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:58.261311 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-63e13c2b-ab6b-43fa-bbf7-6852030c73db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:58.262118 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-63e13c2b-ab6b-43fa-bbf7-6852030c73db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:58.262574 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-63e13c2b-ab6b-43fa-bbf7-6852030c73db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:58.357613 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f3f8a6bb-4da7-41be-8bdc-173c34f2632d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:58.367996 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f3f8a6bb-4da7-41be-8bdc-173c34f2632d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.182518 Nov 02 16:49:58.368679 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 299/579] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:58 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:58.413351 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-63e13c2b-ab6b-43fa-bbf7-6852030c73db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:58.423519 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-63e13c2b-ab6b-43fa-bbf7-6852030c73db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:58.425112 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-63e13c2b-ab6b-43fa-bbf7-6852030c73db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:58.426370 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-63e13c2b-ab6b-43fa-bbf7-6852030c73db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.178357 Nov 02 16:49:58.426987 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 281/580] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:49:58 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:49:58.978030 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bd1af1e1-13c1-4185-8d78-c732fe4d20db tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:58.978763 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-bd1af1e1-13c1-4185-8d78-c732fe4d20db tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:58.986464 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bd1af1e1-13c1-4185-8d78-c732fe4d20db tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:58.986919 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bd1af1e1-13c1-4185-8d78-c732fe4d20db tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:58.987719 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bd1af1e1-13c1-4185-8d78-c732fe4d20db tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:58.988156 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bd1af1e1-13c1-4185-8d78-c732fe4d20db tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:59.134302 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-bd1af1e1-13c1-4185-8d78-c732fe4d20db tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:59.145280 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-bd1af1e1-13c1-4185-8d78-c732fe4d20db tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1559 microversion: 2.1 time: 0.171289 Nov 02 16:49:59.145969 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 300/581] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:58 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:59.167100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9e1ce377-7666-47e4-8582-bbdd5cecba36 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:59.167856 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9e1ce377-7666-47e4-8582-bbdd5cecba36 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:59.176161 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e1ce377-7666-47e4-8582-bbdd5cecba36 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:59.176656 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e1ce377-7666-47e4-8582-bbdd5cecba36 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:59.177493 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e1ce377-7666-47e4-8582-bbdd5cecba36 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:59.177945 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e1ce377-7666-47e4-8582-bbdd5cecba36 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:59.338044 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9e1ce377-7666-47e4-8582-bbdd5cecba36 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:59.346884 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9e1ce377-7666-47e4-8582-bbdd5cecba36 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1517 microversion: 2.1 time: 0.183960 Nov 02 16:49:59.347886 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 282/582] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:59 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:59.387620 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3d5efe63-8435-432e-a488-f2160bfa2d83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:59.388418 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3d5efe63-8435-432e-a488-f2160bfa2d83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:59.396308 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3d5efe63-8435-432e-a488-f2160bfa2d83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:59.396866 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3d5efe63-8435-432e-a488-f2160bfa2d83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:59.397601 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3d5efe63-8435-432e-a488-f2160bfa2d83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:59.398060 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3d5efe63-8435-432e-a488-f2160bfa2d83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:59.446365 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1807cff4-0a1f-42e6-a3f2-dee1ca762d83 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:49:59.447274 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1807cff4-0a1f-42e6-a3f2-dee1ca762d83 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:59.454294 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1807cff4-0a1f-42e6-a3f2-dee1ca762d83 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:59.454760 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1807cff4-0a1f-42e6-a3f2-dee1ca762d83 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:59.455820 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1807cff4-0a1f-42e6-a3f2-dee1ca762d83 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:59.456309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1807cff4-0a1f-42e6-a3f2-dee1ca762d83 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:59.569955 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3d5efe63-8435-432e-a488-f2160bfa2d83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:59.581411 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3d5efe63-8435-432e-a488-f2160bfa2d83 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.197656 Nov 02 16:49:59.582078 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 301/583] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:49:59 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:49:59.588403 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e7b3755c-de0d-4671-ac4f-40aea591037a tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dccd7c60-d08e-4063-8677-210a20e54cb2"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:49:59.589866 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e7b3755c-de0d-4671-ac4f-40aea591037a tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:49:59.597600 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e7b3755c-de0d-4671-ac4f-40aea591037a tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:59.598190 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e7b3755c-de0d-4671-ac4f-40aea591037a tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:59.599148 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e7b3755c-de0d-4671-ac4f-40aea591037a tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:49:59.599613 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e7b3755c-de0d-4671-ac4f-40aea591037a tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:49:59.730384 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1807cff4-0a1f-42e6-a3f2-dee1ca762d83 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:59.742285 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1807cff4-0a1f-42e6-a3f2-dee1ca762d83 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:59.744004 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1807cff4-0a1f-42e6-a3f2-dee1ca762d83 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:49:59.747522 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1807cff4-0a1f-42e6-a3f2-dee1ca762d83 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.304206 Nov 02 16:49:59.749183 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 283/584] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:49:59 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:49:59.911717 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e7b3755c-de0d-4671-ac4f-40aea591037a tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "POST /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328331 Nov 02 16:49:59.912560 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 302/585] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:49:59 2021] POST /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:00.163692 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-425b655f-c364-4307-b344-cc308502eb98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:00.164474 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-425b655f-c364-4307-b344-cc308502eb98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:00.173103 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-425b655f-c364-4307-b344-cc308502eb98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:00.173870 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-425b655f-c364-4307-b344-cc308502eb98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:00.174951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-425b655f-c364-4307-b344-cc308502eb98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:00.175294 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-425b655f-c364-4307-b344-cc308502eb98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:00.182876 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-3ed407a9-89e5-48fc-8f86-10e64a531594 req-2ef0a0e2-cdf6-4953-ab15-a5e86db65b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a4ae9f-e986-4bf1-b110-04ccb11fa669", "name": "network-vif-deleted", "tag": "ae111e5f-0dee-4333-97a4-4539e1360985"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:00.184569 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:50:00.184569 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:50:00.193157 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-3ed407a9-89e5-48fc-8f86-10e64a531594 req-2ef0a0e2-cdf6-4953-ab15-a5e86db65b7c service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:00.193613 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-3ed407a9-89e5-48fc-8f86-10e64a531594 req-2ef0a0e2-cdf6-4953-ab15-a5e86db65b7c service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:00.205944 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-3ed407a9-89e5-48fc-8f86-10e64a531594 req-2ef0a0e2-cdf6-4953-ab15-a5e86db65b7c service nova] Creating event network-vif-deleted:ae111e5f-0dee-4333-97a4-4539e1360985 for instance 62a4ae9f-e986-4bf1-b110-04ccb11fa669 on hv-cinder-77387 Nov 02 16:50:00.211381 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-3ed407a9-89e5-48fc-8f86-10e64a531594 req-2ef0a0e2-cdf6-4953-ab15-a5e86db65b7c service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033475 Nov 02 16:50:00.212309 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 303/586] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:50:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:00.327922 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-425b655f-c364-4307-b344-cc308502eb98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:00.336796 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-425b655f-c364-4307-b344-cc308502eb98 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1559 microversion: 2.1 time: 0.177428 Nov 02 16:50:00.337454 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 284/587] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:00 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:00.366047 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c2ba3ca6-ccfb-4f8f-80e1-b3c5193e6aeb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:00.366771 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c2ba3ca6-ccfb-4f8f-80e1-b3c5193e6aeb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:00.374388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c2ba3ca6-ccfb-4f8f-80e1-b3c5193e6aeb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:00.374868 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c2ba3ca6-ccfb-4f8f-80e1-b3c5193e6aeb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:00.375823 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c2ba3ca6-ccfb-4f8f-80e1-b3c5193e6aeb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:00.376304 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c2ba3ca6-ccfb-4f8f-80e1-b3c5193e6aeb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:00.444210 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c2ba3ca6-ccfb-4f8f-80e1-b3c5193e6aeb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:00.453018 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c2ba3ca6-ccfb-4f8f-80e1-b3c5193e6aeb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1475 microversion: 2.1 time: 0.091618 Nov 02 16:50:00.453663 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 304/588] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:00 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1475 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:00.599521 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-80437b87-5224-4bca-9985-af9425286be5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:00.600030 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-80437b87-5224-4bca-9985-af9425286be5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:00.607031 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-80437b87-5224-4bca-9985-af9425286be5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:00.607700 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-80437b87-5224-4bca-9985-af9425286be5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:00.609261 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-80437b87-5224-4bca-9985-af9425286be5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:00.609714 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-80437b87-5224-4bca-9985-af9425286be5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:00.759493 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-80437b87-5224-4bca-9985-af9425286be5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:00.770720 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-80437b87-5224-4bca-9985-af9425286be5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.175399 Nov 02 16:50:00.771379 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 285/589] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:00 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:00.774829 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-78c23019-4e75-4d4f-a0df-42dfb170e538 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:00.775580 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-78c23019-4e75-4d4f-a0df-42dfb170e538 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:00.784113 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78c23019-4e75-4d4f-a0df-42dfb170e538 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:00.784616 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78c23019-4e75-4d4f-a0df-42dfb170e538 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:00.785443 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78c23019-4e75-4d4f-a0df-42dfb170e538 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:00.785884 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78c23019-4e75-4d4f-a0df-42dfb170e538 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:00.932122 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-78c23019-4e75-4d4f-a0df-42dfb170e538 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:00.941575 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-78c23019-4e75-4d4f-a0df-42dfb170e538 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:00.943154 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-78c23019-4e75-4d4f-a0df-42dfb170e538 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:00.944503 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-78c23019-4e75-4d4f-a0df-42dfb170e538 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.175775 Nov 02 16:50:00.945130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 305/590] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:00 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:01.355357 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-20e07c27-4b15-489f-b67d-4ace9d658df0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:01.356112 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-20e07c27-4b15-489f-b67d-4ace9d658df0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:01.363387 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-20e07c27-4b15-489f-b67d-4ace9d658df0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:01.363854 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-20e07c27-4b15-489f-b67d-4ace9d658df0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:01.364710 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-20e07c27-4b15-489f-b67d-4ace9d658df0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:01.365165 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-20e07c27-4b15-489f-b67d-4ace9d658df0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:01.471379 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0df227d6-1a74-4dad-baef-ce236846aecb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:01.472261 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0df227d6-1a74-4dad-baef-ce236846aecb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:01.479489 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0df227d6-1a74-4dad-baef-ce236846aecb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:01.479965 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0df227d6-1a74-4dad-baef-ce236846aecb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:01.480850 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0df227d6-1a74-4dad-baef-ce236846aecb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:01.481300 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0df227d6-1a74-4dad-baef-ce236846aecb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:01.524868 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-20e07c27-4b15-489f-b67d-4ace9d658df0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:01.540567 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-20e07c27-4b15-489f-b67d-4ace9d658df0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1559 microversion: 2.1 time: 0.188971 Nov 02 16:50:01.541765 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 286/591] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:01 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:01.571673 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0df227d6-1a74-4dad-baef-ce236846aecb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:01.580981 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0df227d6-1a74-4dad-baef-ce236846aecb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1475 microversion: 2.1 time: 0.114209 Nov 02 16:50:01.581733 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 306/592] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:01 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1475 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:01.789574 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b9002aec-6238-4705-a31b-56c44e7c2edd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:01.790202 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b9002aec-6238-4705-a31b-56c44e7c2edd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:01.797806 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b9002aec-6238-4705-a31b-56c44e7c2edd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:01.798306 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b9002aec-6238-4705-a31b-56c44e7c2edd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:01.799162 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b9002aec-6238-4705-a31b-56c44e7c2edd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:01.799601 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b9002aec-6238-4705-a31b-56c44e7c2edd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:01.955958 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b9002aec-6238-4705-a31b-56c44e7c2edd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:01.963772 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7d6abe51-dd77-4e67-b530-4617467f6786 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:01.964490 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7d6abe51-dd77-4e67-b530-4617467f6786 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:01.965838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b9002aec-6238-4705-a31b-56c44e7c2edd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.180182 Nov 02 16:50:01.966462 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 287/593] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:01 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:01.972433 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7d6abe51-dd77-4e67-b530-4617467f6786 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:01.973270 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7d6abe51-dd77-4e67-b530-4617467f6786 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:01.973743 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7d6abe51-dd77-4e67-b530-4617467f6786 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:01.974191 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7d6abe51-dd77-4e67-b530-4617467f6786 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:02.149380 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7d6abe51-dd77-4e67-b530-4617467f6786 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:02.159868 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7d6abe51-dd77-4e67-b530-4617467f6786 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:02.161463 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7d6abe51-dd77-4e67-b530-4617467f6786 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:02.162744 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7d6abe51-dd77-4e67-b530-4617467f6786 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.203414 Nov 02 16:50:02.163379 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 307/594] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:01 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:02.567233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4caf304f-9553-472e-8023-9b0d3e33c5f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:02.567972 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4caf304f-9553-472e-8023-9b0d3e33c5f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:02.575275 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4caf304f-9553-472e-8023-9b0d3e33c5f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:02.575747 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4caf304f-9553-472e-8023-9b0d3e33c5f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:02.576605 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4caf304f-9553-472e-8023-9b0d3e33c5f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:02.577325 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4caf304f-9553-472e-8023-9b0d3e33c5f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:02.599386 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-13a2164c-bfd7-4230-a958-bf27cbd5a551 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:02.600124 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-13a2164c-bfd7-4230-a958-bf27cbd5a551 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:02.608988 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-13a2164c-bfd7-4230-a958-bf27cbd5a551 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:02.609546 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-13a2164c-bfd7-4230-a958-bf27cbd5a551 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:02.610398 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-13a2164c-bfd7-4230-a958-bf27cbd5a551 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:02.610848 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-13a2164c-bfd7-4230-a958-bf27cbd5a551 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:02.683849 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-13a2164c-bfd7-4230-a958-bf27cbd5a551 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:02.695881 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-13a2164c-bfd7-4230-a958-bf27cbd5a551 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1475 microversion: 2.1 time: 0.100468 Nov 02 16:50:02.696899 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 308/595] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:02 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1475 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:02.769775 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4caf304f-9553-472e-8023-9b0d3e33c5f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:02.781972 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4caf304f-9553-472e-8023-9b0d3e33c5f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1559 microversion: 2.1 time: 0.218782 Nov 02 16:50:02.782768 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 288/596] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:02 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:02.988435 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f6ce00d5-8feb-452b-9613-ec4e40d522e7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:02.989082 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f6ce00d5-8feb-452b-9613-ec4e40d522e7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:02.996137 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f6ce00d5-8feb-452b-9613-ec4e40d522e7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:02.996758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f6ce00d5-8feb-452b-9613-ec4e40d522e7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:02.997455 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f6ce00d5-8feb-452b-9613-ec4e40d522e7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:02.997911 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f6ce00d5-8feb-452b-9613-ec4e40d522e7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:03.150449 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f6ce00d5-8feb-452b-9613-ec4e40d522e7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:03.160988 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f6ce00d5-8feb-452b-9613-ec4e40d522e7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.177639 Nov 02 16:50:03.161766 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 309/597] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:02 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:03.184504 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b92af5c9-aaf4-45ae-9717-1ea553e58f8a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:03.185151 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b92af5c9-aaf4-45ae-9717-1ea553e58f8a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:03.193082 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b92af5c9-aaf4-45ae-9717-1ea553e58f8a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:03.193543 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b92af5c9-aaf4-45ae-9717-1ea553e58f8a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:03.194380 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b92af5c9-aaf4-45ae-9717-1ea553e58f8a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:03.194838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b92af5c9-aaf4-45ae-9717-1ea553e58f8a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:03.352843 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b92af5c9-aaf4-45ae-9717-1ea553e58f8a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:03.362583 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b92af5c9-aaf4-45ae-9717-1ea553e58f8a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:03.364243 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b92af5c9-aaf4-45ae-9717-1ea553e58f8a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:03.365511 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b92af5c9-aaf4-45ae-9717-1ea553e58f8a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.185313 Nov 02 16:50:03.366140 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 289/598] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:03 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:03.722418 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-72ce4337-50bf-4920-bdc0-6f5f1121735d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:03.723125 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-72ce4337-50bf-4920-bdc0-6f5f1121735d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:03.730427 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-72ce4337-50bf-4920-bdc0-6f5f1121735d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:03.730959 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-72ce4337-50bf-4920-bdc0-6f5f1121735d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:03.731859 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-72ce4337-50bf-4920-bdc0-6f5f1121735d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:03.732341 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-72ce4337-50bf-4920-bdc0-6f5f1121735d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:03.765764 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-72ce4337-50bf-4920-bdc0-6f5f1121735d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:03.766220 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-72ce4337-50bf-4920-bdc0-6f5f1121735d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:03.766683 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-72ce4337-50bf-4920-bdc0-6f5f1121735d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lazy-loading 'fault' on Instance uuid 62a4ae9f-e986-4bf1-b110-04ccb11fa669 {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:50:03.799586 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c50de69f-17ba-4fad-a875-5db6ad5bba1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:03.800391 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c50de69f-17ba-4fad-a875-5db6ad5bba1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:03.807223 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c50de69f-17ba-4fad-a875-5db6ad5bba1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:03.807693 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c50de69f-17ba-4fad-a875-5db6ad5bba1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:03.808552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c50de69f-17ba-4fad-a875-5db6ad5bba1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:03.810252 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c50de69f-17ba-4fad-a875-5db6ad5bba1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:03.812615 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-72ce4337-50bf-4920-bdc0-6f5f1121735d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:03.822925 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-72ce4337-50bf-4920-bdc0-6f5f1121735d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 200 len: 1312 microversion: 2.1 time: 0.105206 Nov 02 16:50:03.833385 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 310/599] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:03 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:04.000483 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-c50de69f-17ba-4fad-a875-5db6ad5bba1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:04.013228 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c50de69f-17ba-4fad-a875-5db6ad5bba1f tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1565 microversion: 2.1 time: 0.217697 Nov 02 16:50:04.015033 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 290/600] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:03 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1565 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:04.112134 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b167f357-340c-45ec-84da-2831c6034476 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:04.112689 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b167f357-340c-45ec-84da-2831c6034476 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:04.120481 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b167f357-340c-45ec-84da-2831c6034476 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:04.121124 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b167f357-340c-45ec-84da-2831c6034476 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:04.122055 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b167f357-340c-45ec-84da-2831c6034476 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:04.122906 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b167f357-340c-45ec-84da-2831c6034476 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:04.181206 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c3b161ba-3aa4-4629-b12e-ec1a2328dafd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:04.182224 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c3b161ba-3aa4-4629-b12e-ec1a2328dafd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:04.193428 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c3b161ba-3aa4-4629-b12e-ec1a2328dafd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:04.195046 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c3b161ba-3aa4-4629-b12e-ec1a2328dafd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:04.196107 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c3b161ba-3aa4-4629-b12e-ec1a2328dafd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:04.196778 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c3b161ba-3aa4-4629-b12e-ec1a2328dafd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:04.226473 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-b167f357-340c-45ec-84da-2831c6034476 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lazy-loading 'services' on Instance uuid 6e5b406e-d37d-44b0-bb2f-39532baf3f9e {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:50:04.318290 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b167f357-340c-45ec-84da-2831c6034476 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "DELETE /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments/431aaf37-701b-4ec1-a365-72ff60d64d09" status: 202 len: 0 microversion: 2.1 time: 0.210279 Nov 02 16:50:04.319279 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 311/601] 10.222.0.118 () {58 vars in 1420 bytes} [Tue Nov 2 16:50:04 2021] DELETE /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments/431aaf37-701b-4ec1-a365-72ff60d64d09 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:50:04.339532 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e065d6e6-2dbd-43f3-8fb3-a29fc1f02574 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:04.341734 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e065d6e6-2dbd-43f3-8fb3-a29fc1f02574 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:04.356079 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e065d6e6-2dbd-43f3-8fb3-a29fc1f02574 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:04.356972 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e065d6e6-2dbd-43f3-8fb3-a29fc1f02574 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:04.359003 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e065d6e6-2dbd-43f3-8fb3-a29fc1f02574 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:04.359803 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e065d6e6-2dbd-43f3-8fb3-a29fc1f02574 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:04.408933 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e065d6e6-2dbd-43f3-8fb3-a29fc1f02574 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078106 Nov 02 16:50:04.409874 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 312/602] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:50:04 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:50:04.415239 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-994960d2-23b9-443d-a573-84675d484e85 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:04.416152 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-994960d2-23b9-443d-a573-84675d484e85 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:04.424055 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-994960d2-23b9-443d-a573-84675d484e85 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:04.424574 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-994960d2-23b9-443d-a573-84675d484e85 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:04.425612 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-994960d2-23b9-443d-a573-84675d484e85 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:04.426062 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-994960d2-23b9-443d-a573-84675d484e85 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:04.601498 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-994960d2-23b9-443d-a573-84675d484e85 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:04.611903 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-994960d2-23b9-443d-a573-84675d484e85 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:04.613528 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-994960d2-23b9-443d-a573-84675d484e85 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:04.614859 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-994960d2-23b9-443d-a573-84675d484e85 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.204173 Nov 02 16:50:04.615543 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 313/603] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:04 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:04.631109 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-c3b161ba-3aa4-4629-b12e-ec1a2328dafd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:04.646975 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c3b161ba-3aa4-4629-b12e-ec1a2328dafd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.470441 Nov 02 16:50:04.647652 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 291/604] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:04 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:50:04.841694 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-77d8c923-1d35-43d7-af18-211dfa1a8947 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:04.842909 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-77d8c923-1d35-43d7-af18-211dfa1a8947 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: 62a4ae9f-e986-4bf1-b110-04ccb11fa669] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:04.851291 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77d8c923-1d35-43d7-af18-211dfa1a8947 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:04.851961 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77d8c923-1d35-43d7-af18-211dfa1a8947 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:04.852813 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77d8c923-1d35-43d7-af18-211dfa1a8947 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:04.853265 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77d8c923-1d35-43d7-af18-211dfa1a8947 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:04.869767 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-77d8c923-1d35-43d7-af18-211dfa1a8947 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] HTTP exception thrown: Instance 62a4ae9f-e986-4bf1-b110-04ccb11fa669 could not be found. Nov 02 16:50:04.870412 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-77d8c923-1d35-43d7-af18-211dfa1a8947 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Returning 404 to user: Instance 62a4ae9f-e986-4bf1-b110-04ccb11fa669 could not be found. {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:50:04.871303 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-77d8c923-1d35-43d7-af18-211dfa1a8947 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669" status: 404 len: 111 microversion: 2.1 time: 0.033900 Nov 02 16:50:04.871918 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 314/605] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:04 2021] GET /compute/v2.1/servers/62a4ae9f-e986-4bf1-b110-04ccb11fa669 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:50:05.424288 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-88a54769-b17c-4427-9248-e8665594a7c7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:05.425364 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-88a54769-b17c-4427-9248-e8665594a7c7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:05.433156 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-88a54769-b17c-4427-9248-e8665594a7c7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:05.433913 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-88a54769-b17c-4427-9248-e8665594a7c7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:05.434804 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-88a54769-b17c-4427-9248-e8665594a7c7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:05.435206 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-88a54769-b17c-4427-9248-e8665594a7c7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:05.470830 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-88a54769-b17c-4427-9248-e8665594a7c7 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051350 Nov 02 16:50:05.471502 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 292/606] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:50:05 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:05.634926 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8c22d199-8575-4c38-93e6-dd698cdbd325 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:05.635436 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8c22d199-8575-4c38-93e6-dd698cdbd325 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:05.642542 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8c22d199-8575-4c38-93e6-dd698cdbd325 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:05.643004 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8c22d199-8575-4c38-93e6-dd698cdbd325 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:05.643789 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8c22d199-8575-4c38-93e6-dd698cdbd325 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:05.644262 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8c22d199-8575-4c38-93e6-dd698cdbd325 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:05.667241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-12b3b7de-5513-4095-86a4-9b8f395f2839 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:05.667890 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-12b3b7de-5513-4095-86a4-9b8f395f2839 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:05.675124 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-12b3b7de-5513-4095-86a4-9b8f395f2839 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:05.675729 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-12b3b7de-5513-4095-86a4-9b8f395f2839 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:05.676583 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-12b3b7de-5513-4095-86a4-9b8f395f2839 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:05.677031 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-12b3b7de-5513-4095-86a4-9b8f395f2839 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:05.785698 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8c22d199-8575-4c38-93e6-dd698cdbd325 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:05.794372 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8c22d199-8575-4c38-93e6-dd698cdbd325 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:05.796212 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8c22d199-8575-4c38-93e6-dd698cdbd325 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:05.797697 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8c22d199-8575-4c38-93e6-dd698cdbd325 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.167328 Nov 02 16:50:05.798550 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 315/607] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:05 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:05.822419 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-12b3b7de-5513-4095-86a4-9b8f395f2839 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:05.831841 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-12b3b7de-5513-4095-86a4-9b8f395f2839 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.168822 Nov 02 16:50:05.832822 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 293/608] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:05 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:06.484213 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a3b9eebe-b2f6-41e4-a827-80d0ab9b9ca2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:06.485215 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a3b9eebe-b2f6-41e4-a827-80d0ab9b9ca2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:06.492323 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a3b9eebe-b2f6-41e4-a827-80d0ab9b9ca2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:06.492781 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a3b9eebe-b2f6-41e4-a827-80d0ab9b9ca2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:06.493632 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a3b9eebe-b2f6-41e4-a827-80d0ab9b9ca2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:06.494011 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a3b9eebe-b2f6-41e4-a827-80d0ab9b9ca2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:06.527812 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a3b9eebe-b2f6-41e4-a827-80d0ab9b9ca2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048294 Nov 02 16:50:06.528481 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 316/609] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:50:06 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:06.817204 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-30c58b10-9f2d-4bfd-b2e9-b8090c63e84c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:06.817918 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-30c58b10-9f2d-4bfd-b2e9-b8090c63e84c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:06.825721 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30c58b10-9f2d-4bfd-b2e9-b8090c63e84c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:06.826184 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30c58b10-9f2d-4bfd-b2e9-b8090c63e84c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:06.827161 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30c58b10-9f2d-4bfd-b2e9-b8090c63e84c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:06.827673 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30c58b10-9f2d-4bfd-b2e9-b8090c63e84c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:06.849838 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-60d66949-8d4b-4d07-b8e6-082271ea26e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:06.850864 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-60d66949-8d4b-4d07-b8e6-082271ea26e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:06.857643 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-60d66949-8d4b-4d07-b8e6-082271ea26e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:06.858803 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-60d66949-8d4b-4d07-b8e6-082271ea26e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:06.859646 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-60d66949-8d4b-4d07-b8e6-082271ea26e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:06.860099 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-60d66949-8d4b-4d07-b8e6-082271ea26e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:06.997738 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-30c58b10-9f2d-4bfd-b2e9-b8090c63e84c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:07.007631 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-30c58b10-9f2d-4bfd-b2e9-b8090c63e84c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:07.009229 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-30c58b10-9f2d-4bfd-b2e9-b8090c63e84c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:07.010489 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-30c58b10-9f2d-4bfd-b2e9-b8090c63e84c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.197592 Nov 02 16:50:07.011959 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 294/610] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:06 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:50:07.030620 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-60d66949-8d4b-4d07-b8e6-082271ea26e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:07.042902 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-60d66949-8d4b-4d07-b8e6-082271ea26e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.196993 Nov 02 16:50:07.043907 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 317/611] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:06 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:07.541803 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ad68125c-c76c-480c-8c9a-06df92ffd307 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:07.542813 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ad68125c-c76c-480c-8c9a-06df92ffd307 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:07.549755 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ad68125c-c76c-480c-8c9a-06df92ffd307 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:07.550222 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ad68125c-c76c-480c-8c9a-06df92ffd307 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:07.551052 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ad68125c-c76c-480c-8c9a-06df92ffd307 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:07.551608 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ad68125c-c76c-480c-8c9a-06df92ffd307 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:07.586270 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ad68125c-c76c-480c-8c9a-06df92ffd307 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049484 Nov 02 16:50:07.586952 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 295/612] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:50:07 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:08.031185 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-43ba7b81-e2f8-41f0-b401-200909a46839 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:08.032151 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-43ba7b81-e2f8-41f0-b401-200909a46839 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:08.040224 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-43ba7b81-e2f8-41f0-b401-200909a46839 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:08.040694 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-43ba7b81-e2f8-41f0-b401-200909a46839 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:08.041493 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-43ba7b81-e2f8-41f0-b401-200909a46839 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:08.041937 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-43ba7b81-e2f8-41f0-b401-200909a46839 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:08.063724 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-02d5e021-4d92-4291-999f-88ecde8aef4d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:08.064496 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-02d5e021-4d92-4291-999f-88ecde8aef4d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:08.071508 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02d5e021-4d92-4291-999f-88ecde8aef4d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:08.071989 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02d5e021-4d92-4291-999f-88ecde8aef4d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:08.072824 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02d5e021-4d92-4291-999f-88ecde8aef4d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:08.073269 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02d5e021-4d92-4291-999f-88ecde8aef4d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:08.198906 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-43ba7b81-e2f8-41f0-b401-200909a46839 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:08.209043 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-43ba7b81-e2f8-41f0-b401-200909a46839 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:08.210799 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-43ba7b81-e2f8-41f0-b401-200909a46839 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:08.211897 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-43ba7b81-e2f8-41f0-b401-200909a46839 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.185644 Nov 02 16:50:08.212568 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 318/613] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:08 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:08.217804 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1fe44f70-1503-46b4-a1fb-c881da554126 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:08.218693 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1fe44f70-1503-46b4-a1fb-c881da554126 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:08.227011 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1fe44f70-1503-46b4-a1fb-c881da554126 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:08.227482 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1fe44f70-1503-46b4-a1fb-c881da554126 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:08.228691 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1fe44f70-1503-46b4-a1fb-c881da554126 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:08.229232 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1fe44f70-1503-46b4-a1fb-c881da554126 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:08.251289 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-02d5e021-4d92-4291-999f-88ecde8aef4d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:08.261651 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-02d5e021-4d92-4291-999f-88ecde8aef4d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.201815 Nov 02 16:50:08.263044 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 296/614] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:08 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:50:08.263176 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1fe44f70-1503-46b4-a1fb-c881da554126 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Going to try to terminate instance {{(pid=127649) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:50:08.370741 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1fe44f70-1503-46b4-a1fb-c881da554126 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "DELETE /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 204 len: 0 microversion: 2.1 time: 0.156563 Nov 02 16:50:08.371623 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 319/615] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:50:08 2021] DELETE /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:50:08.381282 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-8392e02e-2c6b-4975-ac1d-a957b16958bf tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:08.381923 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8392e02e-2c6b-4975-ac1d-a957b16958bf tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:08.390041 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8392e02e-2c6b-4975-ac1d-a957b16958bf tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:08.390547 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8392e02e-2c6b-4975-ac1d-a957b16958bf tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:08.391223 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8392e02e-2c6b-4975-ac1d-a957b16958bf tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:08.391800 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8392e02e-2c6b-4975-ac1d-a957b16958bf tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:08.567220 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-8392e02e-2c6b-4975-ac1d-a957b16958bf tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:08.576725 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-8392e02e-2c6b-4975-ac1d-a957b16958bf tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1517 microversion: 2.1 time: 0.199494 Nov 02 16:50:08.577324 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 297/616] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:08 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1517 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:08.601763 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-05fdf3ee-bf50-4a03-b38e-721dad1923c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:08.602909 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-05fdf3ee-bf50-4a03-b38e-721dad1923c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:08.610801 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-05fdf3ee-bf50-4a03-b38e-721dad1923c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:08.611278 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-05fdf3ee-bf50-4a03-b38e-721dad1923c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:08.612104 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-05fdf3ee-bf50-4a03-b38e-721dad1923c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:08.612595 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-05fdf3ee-bf50-4a03-b38e-721dad1923c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:08.648677 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-05fdf3ee-bf50-4a03-b38e-721dad1923c2 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052214 Nov 02 16:50:08.652303 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 320/617] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:50:08 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:09.232160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d0910b88-af47-406b-9c49-b85ae261ab55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:09.233286 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d0910b88-af47-406b-9c49-b85ae261ab55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:09.242198 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0910b88-af47-406b-9c49-b85ae261ab55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:09.243472 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0910b88-af47-406b-9c49-b85ae261ab55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:09.244369 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0910b88-af47-406b-9c49-b85ae261ab55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:09.244867 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0910b88-af47-406b-9c49-b85ae261ab55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:09.281361 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-57ed948f-f990-433b-83b2-06e7d7cf52b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:09.282126 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-57ed948f-f990-433b-83b2-06e7d7cf52b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:09.289957 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-57ed948f-f990-433b-83b2-06e7d7cf52b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:09.290417 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-57ed948f-f990-433b-83b2-06e7d7cf52b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:09.291228 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-57ed948f-f990-433b-83b2-06e7d7cf52b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:09.291668 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-57ed948f-f990-433b-83b2-06e7d7cf52b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:09.416690 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d0910b88-af47-406b-9c49-b85ae261ab55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:09.426799 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d0910b88-af47-406b-9c49-b85ae261ab55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:09.428549 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d0910b88-af47-406b-9c49-b85ae261ab55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:09.429825 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d0910b88-af47-406b-9c49-b85ae261ab55 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.202196 Nov 02 16:50:09.430498 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 298/618] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:09 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:09.446265 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-57ed948f-f990-433b-83b2-06e7d7cf52b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:09.456932 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-57ed948f-f990-433b-83b2-06e7d7cf52b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.180269 Nov 02 16:50:09.457590 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 321/619] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:09 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:50:09.595192 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-668210a7-01aa-453b-baed-9f4a7b9754cc tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:09.595869 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-668210a7-01aa-453b-baed-9f4a7b9754cc tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:09.602849 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-668210a7-01aa-453b-baed-9f4a7b9754cc tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:09.603319 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-668210a7-01aa-453b-baed-9f4a7b9754cc tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:09.604129 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-668210a7-01aa-453b-baed-9f4a7b9754cc tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:09.604843 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-668210a7-01aa-453b-baed-9f4a7b9754cc tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:09.661991 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f0d8ff14-997a-45ea-8972-36c03b66a0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:09.663197 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f0d8ff14-997a-45ea-8972-36c03b66a0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:09.670301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f0d8ff14-997a-45ea-8972-36c03b66a0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:09.671019 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f0d8ff14-997a-45ea-8972-36c03b66a0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:09.672548 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f0d8ff14-997a-45ea-8972-36c03b66a0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:09.672548 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f0d8ff14-997a-45ea-8972-36c03b66a0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:09.707981 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f0d8ff14-997a-45ea-8972-36c03b66a0f1 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050153 Nov 02 16:50:09.708694 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 322/620] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:50:09 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:09.767491 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-668210a7-01aa-453b-baed-9f4a7b9754cc tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:09.777379 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-668210a7-01aa-453b-baed-9f4a7b9754cc tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1517 microversion: 2.1 time: 0.186261 Nov 02 16:50:09.778072 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 299/621] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:09 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:10.450930 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8fcc9d2f-b9e8-4be6-a4eb-d3c2aa3d2d86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:10.452076 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8fcc9d2f-b9e8-4be6-a4eb-d3c2aa3d2d86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:10.460366 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8fcc9d2f-b9e8-4be6-a4eb-d3c2aa3d2d86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:10.460910 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8fcc9d2f-b9e8-4be6-a4eb-d3c2aa3d2d86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:10.461912 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8fcc9d2f-b9e8-4be6-a4eb-d3c2aa3d2d86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:10.462441 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8fcc9d2f-b9e8-4be6-a4eb-d3c2aa3d2d86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:10.475127 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3376c614-18ca-40aa-a89a-2e727ba76297 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:10.475870 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3376c614-18ca-40aa-a89a-2e727ba76297 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:10.486658 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3376c614-18ca-40aa-a89a-2e727ba76297 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:10.487124 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3376c614-18ca-40aa-a89a-2e727ba76297 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:10.488084 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3376c614-18ca-40aa-a89a-2e727ba76297 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:10.488591 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3376c614-18ca-40aa-a89a-2e727ba76297 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:10.660986 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3376c614-18ca-40aa-a89a-2e727ba76297 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:10.670953 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3376c614-18ca-40aa-a89a-2e727ba76297 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.199825 Nov 02 16:50:10.676420 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 300/622] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:10 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:10.691875 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8fcc9d2f-b9e8-4be6-a4eb-d3c2aa3d2d86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:10.702070 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8fcc9d2f-b9e8-4be6-a4eb-d3c2aa3d2d86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:10.703804 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8fcc9d2f-b9e8-4be6-a4eb-d3c2aa3d2d86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:10.705121 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8fcc9d2f-b9e8-4be6-a4eb-d3c2aa3d2d86 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.258483 Nov 02 16:50:10.705734 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 323/623] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:10 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:10.721504 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a4e6b915-5ba3-49e3-8d9d-cb03191ebf08 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:10.722577 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a4e6b915-5ba3-49e3-8d9d-cb03191ebf08 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:10.729758 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a4e6b915-5ba3-49e3-8d9d-cb03191ebf08 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:10.730227 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a4e6b915-5ba3-49e3-8d9d-cb03191ebf08 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:10.731039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a4e6b915-5ba3-49e3-8d9d-cb03191ebf08 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:10.732610 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a4e6b915-5ba3-49e3-8d9d-cb03191ebf08 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:10.750913 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-476deb47-20bb-4bdf-b624-bcbcfbe59b67 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:10.751771 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-476deb47-20bb-4bdf-b624-bcbcfbe59b67 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:10.758984 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-476deb47-20bb-4bdf-b624-bcbcfbe59b67 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:10.759490 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-476deb47-20bb-4bdf-b624-bcbcfbe59b67 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:10.760420 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-476deb47-20bb-4bdf-b624-bcbcfbe59b67 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:10.760806 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-476deb47-20bb-4bdf-b624-bcbcfbe59b67 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:10.770686 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a4e6b915-5ba3-49e3-8d9d-cb03191ebf08 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054193 Nov 02 16:50:10.771752 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 301/624] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:50:10 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:10.796092 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-98c6ae76-bb1a-47e3-971b-9c12a66cf7ca tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:10.796899 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-98c6ae76-bb1a-47e3-971b-9c12a66cf7ca tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:10.803994 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-98c6ae76-bb1a-47e3-971b-9c12a66cf7ca tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:10.804493 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-98c6ae76-bb1a-47e3-971b-9c12a66cf7ca tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:10.805318 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-98c6ae76-bb1a-47e3-971b-9c12a66cf7ca tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:10.805769 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-98c6ae76-bb1a-47e3-971b-9c12a66cf7ca tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:10.929641 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-476deb47-20bb-4bdf-b624-bcbcfbe59b67 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:10.939973 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-476deb47-20bb-4bdf-b624-bcbcfbe59b67 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1597 microversion: 2.1 time: 0.194841 Nov 02 16:50:10.940815 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 324/625] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:10 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1597 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:10.988151 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-98c6ae76-bb1a-47e3-971b-9c12a66cf7ca tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:10.997684 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-98c6ae76-bb1a-47e3-971b-9c12a66cf7ca tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1517 microversion: 2.1 time: 0.205980 Nov 02 16:50:10.998495 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 302/626] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:10 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:50:11.690152 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-93a7eb98-5b38-4b75-840b-81641d4bc8c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:11.691209 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-93a7eb98-5b38-4b75-840b-81641d4bc8c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:11.698274 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-93a7eb98-5b38-4b75-840b-81641d4bc8c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:11.698736 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-93a7eb98-5b38-4b75-840b-81641d4bc8c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:11.699807 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-93a7eb98-5b38-4b75-840b-81641d4bc8c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:11.702115 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-93a7eb98-5b38-4b75-840b-81641d4bc8c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:11.727349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-dd414f31-279f-4769-9110-f4046040a735 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:11.729034 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-dd414f31-279f-4769-9110-f4046040a735 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:11.738573 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dd414f31-279f-4769-9110-f4046040a735 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:11.739272 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dd414f31-279f-4769-9110-f4046040a735 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:11.740546 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dd414f31-279f-4769-9110-f4046040a735 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:11.741147 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dd414f31-279f-4769-9110-f4046040a735 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:11.888150 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-93a7eb98-5b38-4b75-840b-81641d4bc8c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:11.899653 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-93a7eb98-5b38-4b75-840b-81641d4bc8c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.214205 Nov 02 16:50:11.900378 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 325/627] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:11 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:11.908716 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-d94c8940-7e86-49a7-945c-339f629f57af tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:11.909800 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d94c8940-7e86-49a7-945c-339f629f57af tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:11.917086 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d94c8940-7e86-49a7-945c-339f629f57af tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:11.917643 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d94c8940-7e86-49a7-945c-339f629f57af tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:11.919141 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d94c8940-7e86-49a7-945c-339f629f57af tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:11.919594 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d94c8940-7e86-49a7-945c-339f629f57af tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:11.959703 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-d94c8940-7e86-49a7-945c-339f629f57af tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056371 Nov 02 16:50:11.960939 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 326/628] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:50:11 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:50:12.001284 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-f9d7f26c-2af5-435b-8d2e-574b087dd976 req-aaaf084e-b469-4a7f-b9b3-fd96fda4c056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdee2c0e-24c6-4a99-8dce-73d69b59a7a2", "name": "network-vif-deleted", "tag": "ae21c04d-1584-4ff1-80e2-e50cf95ef8ad"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:12.003545 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:50:12.003545 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:50:12.028107 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-f9d7f26c-2af5-435b-8d2e-574b087dd976 req-aaaf084e-b469-4a7f-b9b3-fd96fda4c056 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:12.028736 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-f9d7f26c-2af5-435b-8d2e-574b087dd976 req-aaaf084e-b469-4a7f-b9b3-fd96fda4c056 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:12.057974 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-f9d7f26c-2af5-435b-8d2e-574b087dd976 req-aaaf084e-b469-4a7f-b9b3-fd96fda4c056 service nova] Creating event network-vif-deleted:ae21c04d-1584-4ff1-80e2-e50cf95ef8ad for instance fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 on hv-cinder-77387 Nov 02 16:50:12.067267 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-f9d7f26c-2af5-435b-8d2e-574b087dd976 req-aaaf084e-b469-4a7f-b9b3-fd96fda4c056 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070600 Nov 02 16:50:12.069343 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 327/629] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:50:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:12.077222 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-93d9c12f-e184-4c26-9f30-3fe34fb776b8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:12.079099 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-93d9c12f-e184-4c26-9f30-3fe34fb776b8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:12.088774 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-93d9c12f-e184-4c26-9f30-3fe34fb776b8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:12.089743 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-93d9c12f-e184-4c26-9f30-3fe34fb776b8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:12.091476 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-93d9c12f-e184-4c26-9f30-3fe34fb776b8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:12.092753 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-93d9c12f-e184-4c26-9f30-3fe34fb776b8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:12.182706 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-93d9c12f-e184-4c26-9f30-3fe34fb776b8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:12.193094 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-93d9c12f-e184-4c26-9f30-3fe34fb776b8 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 200 len: 1307 microversion: 2.1 time: 0.121480 Nov 02 16:50:12.193777 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 328/630] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:12 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 1307 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:12.266567 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-dd414f31-279f-4769-9110-f4046040a735 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:12.275654 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-dd414f31-279f-4769-9110-f4046040a735 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:12.277351 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-dd414f31-279f-4769-9110-f4046040a735 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:12.278625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-dd414f31-279f-4769-9110-f4046040a735 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.557431 Nov 02 16:50:12.279699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 303/631] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:11 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:12.918574 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a7f4fffe-8ef1-45b7-989c-35f621a9da66 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:12.919320 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a7f4fffe-8ef1-45b7-989c-35f621a9da66 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:12.930615 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a7f4fffe-8ef1-45b7-989c-35f621a9da66 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:12.931144 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a7f4fffe-8ef1-45b7-989c-35f621a9da66 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:12.932026 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a7f4fffe-8ef1-45b7-989c-35f621a9da66 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:12.932524 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a7f4fffe-8ef1-45b7-989c-35f621a9da66 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:13.075484 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a7f4fffe-8ef1-45b7-989c-35f621a9da66 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:13.086602 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a7f4fffe-8ef1-45b7-989c-35f621a9da66 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.172137 Nov 02 16:50:13.087260 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 329/632] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:12 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:13.216931 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6ac80b63-34f8-4a84-817b-0c7253e92e2a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:13.217700 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6ac80b63-34f8-4a84-817b-0c7253e92e2a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: fdee2c0e-24c6-4a99-8dce-73d69b59a7a2] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:13.225628 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6ac80b63-34f8-4a84-817b-0c7253e92e2a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:13.226246 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6ac80b63-34f8-4a84-817b-0c7253e92e2a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:13.227326 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6ac80b63-34f8-4a84-817b-0c7253e92e2a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:13.228049 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6ac80b63-34f8-4a84-817b-0c7253e92e2a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:13.251005 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-6ac80b63-34f8-4a84-817b-0c7253e92e2a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] HTTP exception thrown: Instance fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 could not be found. Nov 02 16:50:13.251161 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6ac80b63-34f8-4a84-817b-0c7253e92e2a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Returning 404 to user: Instance fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:50:13.252499 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6ac80b63-34f8-4a84-817b-0c7253e92e2a tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2" status: 404 len: 111 microversion: 2.1 time: 0.039789 Nov 02 16:50:13.253139 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 304/633] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:13 2021] GET /compute/v2.1/servers/fdee2c0e-24c6-4a99-8dce-73d69b59a7a2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:50:13.262233 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0b44a80e-7463-44a7-8eea-d3dbf2528d65 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:13.262772 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0b44a80e-7463-44a7-8eea-d3dbf2528d65 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:13.270710 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b44a80e-7463-44a7-8eea-d3dbf2528d65 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:13.271185 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b44a80e-7463-44a7-8eea-d3dbf2528d65 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:13.272277 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b44a80e-7463-44a7-8eea-d3dbf2528d65 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:13.272949 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b44a80e-7463-44a7-8eea-d3dbf2528d65 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:13.299175 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-08f507cb-5b11-43d2-b29d-34cf47ceb134 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:13.299824 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-08f507cb-5b11-43d2-b29d-34cf47ceb134 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:13.309019 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-08f507cb-5b11-43d2-b29d-34cf47ceb134 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:13.309914 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-08f507cb-5b11-43d2-b29d-34cf47ceb134 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:13.313778 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0b44a80e-7463-44a7-8eea-d3dbf2528d65 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Going to try to terminate instance {{(pid=127649) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:50:13.316509 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-08f507cb-5b11-43d2-b29d-34cf47ceb134 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:13.317699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-08f507cb-5b11-43d2-b29d-34cf47ceb134 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:13.428434 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0b44a80e-7463-44a7-8eea-d3dbf2528d65 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "DELETE /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 204 len: 0 microversion: 2.1 time: 0.169979 Nov 02 16:50:13.429260 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 330/634] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:50:13 2021] DELETE /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:50:13.441011 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-45b7b4bc-37e3-4cbc-aba5-8e7ff04d5fd9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:13.442083 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-45b7b4bc-37e3-4cbc-aba5-8e7ff04d5fd9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:13.449235 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-45b7b4bc-37e3-4cbc-aba5-8e7ff04d5fd9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:13.449674 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-45b7b4bc-37e3-4cbc-aba5-8e7ff04d5fd9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:13.450721 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-45b7b4bc-37e3-4cbc-aba5-8e7ff04d5fd9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:13.451445 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-45b7b4bc-37e3-4cbc-aba5-8e7ff04d5fd9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:13.627958 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-45b7b4bc-37e3-4cbc-aba5-8e7ff04d5fd9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:13.638773 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-45b7b4bc-37e3-4cbc-aba5-8e7ff04d5fd9 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1517 microversion: 2.1 time: 0.204654 Nov 02 16:50:13.640912 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 331/635] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:13 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:50:13.870542 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-08f507cb-5b11-43d2-b29d-34cf47ceb134 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:13.879899 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-08f507cb-5b11-43d2-b29d-34cf47ceb134 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:13.881824 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-08f507cb-5b11-43d2-b29d-34cf47ceb134 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:13.883311 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-08f507cb-5b11-43d2-b29d-34cf47ceb134 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.589088 Nov 02 16:50:13.891457 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 305/636] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:13 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:14.104019 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6bb4bb20-a09c-4920-99de-4b896643744d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:14.104793 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6bb4bb20-a09c-4920-99de-4b896643744d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:14.111949 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6bb4bb20-a09c-4920-99de-4b896643744d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:14.112773 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6bb4bb20-a09c-4920-99de-4b896643744d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:14.113602 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6bb4bb20-a09c-4920-99de-4b896643744d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:14.114043 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6bb4bb20-a09c-4920-99de-4b896643744d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:14.196612 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-35380d50-4b7f-4d91-9e3c-8bb08253f143 req-7193fa45-ba26-4455-9c18-07e8e4834116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd91cbf0-2d7e-4a11-9073-6e61ccfc7295", "tag": "dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:14.199835 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:50:14.199835 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:50:14.213031 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-35380d50-4b7f-4d91-9e3c-8bb08253f143 req-7193fa45-ba26-4455-9c18-07e8e4834116 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:14.213727 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-35380d50-4b7f-4d91-9e3c-8bb08253f143 req-7193fa45-ba26-4455-9c18-07e8e4834116 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:14.235533 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-35380d50-4b7f-4d91-9e3c-8bb08253f143 req-7193fa45-ba26-4455-9c18-07e8e4834116 service nova] Creating event network-changed:dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e for instance fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 on hv-cinder-77387 Nov 02 16:50:14.251757 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-35380d50-4b7f-4d91-9e3c-8bb08253f143 req-7193fa45-ba26-4455-9c18-07e8e4834116 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059317 Nov 02 16:50:14.254378 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 306/637] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:50:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:50:14.408449 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6bb4bb20-a09c-4920-99de-4b896643744d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:14.426259 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d71afbbb-fbc2-410e-a08b-aee611a932b5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:14.426872 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d71afbbb-fbc2-410e-a08b-aee611a932b5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:14.430733 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6bb4bb20-a09c-4920-99de-4b896643744d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.329826 Nov 02 16:50:14.441116 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d71afbbb-fbc2-410e-a08b-aee611a932b5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:14.442277 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d71afbbb-fbc2-410e-a08b-aee611a932b5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:14.443764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d71afbbb-fbc2-410e-a08b-aee611a932b5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:14.446756 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 332/638] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:14 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:14.450547 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d71afbbb-fbc2-410e-a08b-aee611a932b5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:14.560305 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d71afbbb-fbc2-410e-a08b-aee611a932b5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Going to try to terminate instance {{(pid=127648) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:50:14.660723 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8abb0a91-8fe0-465f-980c-81b92c42da21 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:14.661233 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8abb0a91-8fe0-465f-980c-81b92c42da21 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:14.674140 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8abb0a91-8fe0-465f-980c-81b92c42da21 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:14.674934 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8abb0a91-8fe0-465f-980c-81b92c42da21 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:14.679583 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8abb0a91-8fe0-465f-980c-81b92c42da21 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:14.680410 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8abb0a91-8fe0-465f-980c-81b92c42da21 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:14.723168 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d71afbbb-fbc2-410e-a08b-aee611a932b5 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "DELETE /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 204 len: 0 microversion: 2.1 time: 0.301126 Nov 02 16:50:14.725019 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 307/639] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:50:14 2021] DELETE /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:50:14.751432 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e4cf4668-a450-49dd-acfa-8389673e3d1d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:14.752837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e4cf4668-a450-49dd-acfa-8389673e3d1d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:14.780660 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4cf4668-a450-49dd-acfa-8389673e3d1d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:14.781618 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4cf4668-a450-49dd-acfa-8389673e3d1d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:14.787053 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4cf4668-a450-49dd-acfa-8389673e3d1d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:14.790891 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4cf4668-a450-49dd-acfa-8389673e3d1d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:15.024164 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8abb0a91-8fe0-465f-980c-81b92c42da21 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:15.035402 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8abb0a91-8fe0-465f-980c-81b92c42da21 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1517 microversion: 2.1 time: 0.380572 Nov 02 16:50:15.036449 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 333/640] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:14 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1517 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:50:15.041242 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bef731fe-b406-4019-9cca-3ceecf1b7ee2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:15.042147 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-bef731fe-b406-4019-9cca-3ceecf1b7ee2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:15.049946 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bef731fe-b406-4019-9cca-3ceecf1b7ee2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:15.050793 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bef731fe-b406-4019-9cca-3ceecf1b7ee2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:15.051856 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bef731fe-b406-4019-9cca-3ceecf1b7ee2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:15.052537 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bef731fe-b406-4019-9cca-3ceecf1b7ee2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:15.145560 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e4cf4668-a450-49dd-acfa-8389673e3d1d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:15.155229 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e4cf4668-a450-49dd-acfa-8389673e3d1d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1511 microversion: 2.1 time: 0.425169 Nov 02 16:50:15.156480 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 308/641] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:14 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1511 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:50:15.449632 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-302968bf-5ba6-4b4a-8641-c7f5776a9672 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:15.450427 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-302968bf-5ba6-4b4a-8641-c7f5776a9672 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:15.457996 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-302968bf-5ba6-4b4a-8641-c7f5776a9672 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:15.458389 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-302968bf-5ba6-4b4a-8641-c7f5776a9672 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:15.459707 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-302968bf-5ba6-4b4a-8641-c7f5776a9672 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:15.460582 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-302968bf-5ba6-4b4a-8641-c7f5776a9672 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:15.523298 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-bef731fe-b406-4019-9cca-3ceecf1b7ee2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:15.544255 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-bef731fe-b406-4019-9cca-3ceecf1b7ee2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:15.548130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-bef731fe-b406-4019-9cca-3ceecf1b7ee2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:15.550714 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-bef731fe-b406-4019-9cca-3ceecf1b7ee2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.513223 Nov 02 16:50:15.551935 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 334/642] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:15 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:15.703264 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-302968bf-5ba6-4b4a-8641-c7f5776a9672 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:15.718038 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-302968bf-5ba6-4b4a-8641-c7f5776a9672 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.270679 Nov 02 16:50:15.719343 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 309/643] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:15 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:50:16.053484 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5bdd8587-51ae-4e13-906d-1f406a0d938f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:16.054555 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5bdd8587-51ae-4e13-906d-1f406a0d938f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:16.073356 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5bdd8587-51ae-4e13-906d-1f406a0d938f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:16.074420 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5bdd8587-51ae-4e13-906d-1f406a0d938f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:16.075794 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5bdd8587-51ae-4e13-906d-1f406a0d938f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:16.076699 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5bdd8587-51ae-4e13-906d-1f406a0d938f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:16.180571 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e66868ee-02e7-46aa-b757-61600aaaa3d4 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:16.181532 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e66868ee-02e7-46aa-b757-61600aaaa3d4 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:16.204661 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e66868ee-02e7-46aa-b757-61600aaaa3d4 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:16.205145 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e66868ee-02e7-46aa-b757-61600aaaa3d4 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:16.206019 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e66868ee-02e7-46aa-b757-61600aaaa3d4 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:16.206477 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e66868ee-02e7-46aa-b757-61600aaaa3d4 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:16.300697 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5bdd8587-51ae-4e13-906d-1f406a0d938f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:16.312144 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5bdd8587-51ae-4e13-906d-1f406a0d938f tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 200 len: 1517 microversion: 2.1 time: 0.262047 Nov 02 16:50:16.335939 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 335/644] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:16 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 1517 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:16.351206 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7505490b-f8f9-4521-9b60-fd0a7f92c089 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-461784665"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:16.351788 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7505490b-f8f9-4521-9b60-fd0a7f92c089 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:16.361074 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7505490b-f8f9-4521-9b60-fd0a7f92c089 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:16.362126 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7505490b-f8f9-4521-9b60-fd0a7f92c089 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:16.363142 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7505490b-f8f9-4521-9b60-fd0a7f92c089 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:16.363755 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7505490b-f8f9-4521-9b60-fd0a7f92c089 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:16.424805 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e66868ee-02e7-46aa-b757-61600aaaa3d4 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:16.433957 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e66868ee-02e7-46aa-b757-61600aaaa3d4 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1511 microversion: 2.1 time: 0.261176 Nov 02 16:50:16.434614 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 310/645] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:16 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1511 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:16.440354 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-dec93ecf-c005-484d-8123-1bfcab414a74 req-cbc8737f-9fe3-4b63-bcd1-175552d8947f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc421583-8747-41db-b896-e40bed32a554", "name": "network-vif-deleted", "tag": "f4eb8e96-4a89-4943-bb1e-67b3c0d0953e"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:16.442066 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:50:16.442066 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:50:16.450317 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-dec93ecf-c005-484d-8123-1bfcab414a74 req-cbc8737f-9fe3-4b63-bcd1-175552d8947f service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:16.452278 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-dec93ecf-c005-484d-8123-1bfcab414a74 req-cbc8737f-9fe3-4b63-bcd1-175552d8947f service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:16.465869 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-dec93ecf-c005-484d-8123-1bfcab414a74 req-cbc8737f-9fe3-4b63-bcd1-175552d8947f service nova] Creating event network-vif-deleted:f4eb8e96-4a89-4943-bb1e-67b3c0d0953e for instance cc421583-8747-41db-b896-e40bed32a554 on hv-cinder-77387 Nov 02 16:50:16.471117 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-dec93ecf-c005-484d-8123-1bfcab414a74 req-cbc8737f-9fe3-4b63-bcd1-175552d8947f service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035170 Nov 02 16:50:16.471909 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 311/646] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:50:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:16.533144 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.network.security_group_api [None req-7505490b-f8f9-4521-9b60-fd0a7f92c089 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Adding security group 51a5be46-46b8-4574-9203-4a50b68dea4b to port dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e Nov 02 16:50:16.578582 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ce5acd6c-289d-4f54-bc96-d80323a6e99d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:16.579203 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ce5acd6c-289d-4f54-bc96-d80323a6e99d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:16.586702 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ce5acd6c-289d-4f54-bc96-d80323a6e99d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:16.587175 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ce5acd6c-289d-4f54-bc96-d80323a6e99d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:16.588000 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ce5acd6c-289d-4f54-bc96-d80323a6e99d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:16.588489 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ce5acd6c-289d-4f54-bc96-d80323a6e99d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:16.742709 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ce5acd6c-289d-4f54-bc96-d80323a6e99d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:16.753021 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ce5acd6c-289d-4f54-bc96-d80323a6e99d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:16.754613 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ce5acd6c-289d-4f54-bc96-d80323a6e99d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:16.755896 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ce5acd6c-289d-4f54-bc96-d80323a6e99d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.182942 Nov 02 16:50:16.756564 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 312/647] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:16 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:50:16.761797 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9ccf3f32-0421-46ae-9af5-3ab0ec66f5b2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:16.762448 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9ccf3f32-0421-46ae-9af5-3ab0ec66f5b2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:16.770852 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9ccf3f32-0421-46ae-9af5-3ab0ec66f5b2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:16.771341 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9ccf3f32-0421-46ae-9af5-3ab0ec66f5b2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:16.772385 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9ccf3f32-0421-46ae-9af5-3ab0ec66f5b2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:16.772638 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9ccf3f32-0421-46ae-9af5-3ab0ec66f5b2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:16.935584 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7505490b-f8f9-4521-9b60-fd0a7f92c089 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "POST /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/action" status: 202 len: 0 microversion: 2.1 time: 0.594808 Nov 02 16:50:16.938231 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 336/648] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:50:16 2021] POST /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:50:16.949787 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9ccf3f32-0421-46ae-9af5-3ab0ec66f5b2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:16.955229 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-049daeba-7027-497f-a943-77184b1b7dd5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:16.957135 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-049daeba-7027-497f-a943-77184b1b7dd5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:16.971861 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9ccf3f32-0421-46ae-9af5-3ab0ec66f5b2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.213625 Nov 02 16:50:16.975504 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-049daeba-7027-497f-a943-77184b1b7dd5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:16.976670 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 313/649] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:16 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:16.978975 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-049daeba-7027-497f-a943-77184b1b7dd5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:16.979997 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-049daeba-7027-497f-a943-77184b1b7dd5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:16.984407 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-e7898c2e-80ff-4e5e-8587-1b8a16412873 req-0acd7783-4368-4373-a745-e66f9ab60900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd91cbf0-2d7e-4a11-9073-6e61ccfc7295", "tag": "dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:16.985138 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-049daeba-7027-497f-a943-77184b1b7dd5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:16.994624 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:50:16.994624 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:50:17.005365 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-e7898c2e-80ff-4e5e-8587-1b8a16412873 req-0acd7783-4368-4373-a745-e66f9ab60900 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:17.005681 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-e7898c2e-80ff-4e5e-8587-1b8a16412873 req-0acd7783-4368-4373-a745-e66f9ab60900 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:17.022200 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-e7898c2e-80ff-4e5e-8587-1b8a16412873 req-0acd7783-4368-4373-a745-e66f9ab60900 service nova] Creating event network-changed:dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e for instance fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 on hv-cinder-77387 Nov 02 16:50:17.030455 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-e7898c2e-80ff-4e5e-8587-1b8a16412873 req-0acd7783-4368-4373-a745-e66f9ab60900 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051811 Nov 02 16:50:17.038739 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 314/650] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:50:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:17.278940 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-049daeba-7027-497f-a943-77184b1b7dd5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:17.289364 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-049daeba-7027-497f-a943-77184b1b7dd5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1761 microversion: 2.1 time: 0.344268 Nov 02 16:50:17.290426 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 337/651] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:16 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1761 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:17.331781 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-dfd7426f-4200-4791-b8e0-af1f9ef18488 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:17.332549 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-dfd7426f-4200-4791-b8e0-af1f9ef18488 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: cc421583-8747-41db-b896-e40bed32a554] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:17.339819 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dfd7426f-4200-4791-b8e0-af1f9ef18488 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:17.340420 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dfd7426f-4200-4791-b8e0-af1f9ef18488 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:17.341234 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dfd7426f-4200-4791-b8e0-af1f9ef18488 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:17.341686 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dfd7426f-4200-4791-b8e0-af1f9ef18488 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:17.360368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-dfd7426f-4200-4791-b8e0-af1f9ef18488 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] HTTP exception thrown: Instance cc421583-8747-41db-b896-e40bed32a554 could not be found. Nov 02 16:50:17.361356 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-dfd7426f-4200-4791-b8e0-af1f9ef18488 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Returning 404 to user: Instance cc421583-8747-41db-b896-e40bed32a554 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:50:17.361937 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-dfd7426f-4200-4791-b8e0-af1f9ef18488 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554" status: 404 len: 111 microversion: 2.1 time: 0.034844 Nov 02 16:50:17.365716 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 315/652] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:17 2021] GET /compute/v2.1/servers/cc421583-8747-41db-b896-e40bed32a554 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:50:17.454369 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8b925a18-1744-4de2-8655-0fdfc655db5a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:17.456241 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8b925a18-1744-4de2-8655-0fdfc655db5a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:17.466800 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8b925a18-1744-4de2-8655-0fdfc655db5a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:17.468889 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8b925a18-1744-4de2-8655-0fdfc655db5a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:17.469804 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8b925a18-1744-4de2-8655-0fdfc655db5a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:17.470262 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8b925a18-1744-4de2-8655-0fdfc655db5a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:17.659167 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8b925a18-1744-4de2-8655-0fdfc655db5a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:17.667694 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8b925a18-1744-4de2-8655-0fdfc655db5a tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1511 microversion: 2.1 time: 0.219149 Nov 02 16:50:17.668746 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 338/653] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:17 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:17.780656 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f79f6559-3f6c-49a8-80f9-b2b7ff8acaf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:17.781521 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f79f6559-3f6c-49a8-80f9-b2b7ff8acaf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:17.789967 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f79f6559-3f6c-49a8-80f9-b2b7ff8acaf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:17.790828 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f79f6559-3f6c-49a8-80f9-b2b7ff8acaf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:17.791664 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f79f6559-3f6c-49a8-80f9-b2b7ff8acaf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:17.792354 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f79f6559-3f6c-49a8-80f9-b2b7ff8acaf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:17.947328 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f79f6559-3f6c-49a8-80f9-b2b7ff8acaf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:17.958095 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f79f6559-3f6c-49a8-80f9-b2b7ff8acaf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:17.959730 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f79f6559-3f6c-49a8-80f9-b2b7ff8acaf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:17.961012 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f79f6559-3f6c-49a8-80f9-b2b7ff8acaf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.187868 Nov 02 16:50:17.961631 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 316/654] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:17 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:17.996409 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e1d9bdf0-b41a-45f9-970d-284b781a82ea tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:17.997042 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e1d9bdf0-b41a-45f9-970d-284b781a82ea tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:18.007553 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e1d9bdf0-b41a-45f9-970d-284b781a82ea tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:18.008442 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e1d9bdf0-b41a-45f9-970d-284b781a82ea tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:18.009895 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e1d9bdf0-b41a-45f9-970d-284b781a82ea tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:18.010711 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e1d9bdf0-b41a-45f9-970d-284b781a82ea tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:18.164700 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e1d9bdf0-b41a-45f9-970d-284b781a82ea tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:18.174882 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e1d9bdf0-b41a-45f9-970d-284b781a82ea tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1727 microversion: 2.1 time: 0.182537 Nov 02 16:50:18.175563 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 339/655] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:17 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:50:18.525379 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-bc853f20-aa89-4b7b-9820-ea98592cad16 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:18.525918 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-bc853f20-aa89-4b7b-9820-ea98592cad16 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:18.540487 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bc853f20-aa89-4b7b-9820-ea98592cad16 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:18.540961 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bc853f20-aa89-4b7b-9820-ea98592cad16 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:18.541794 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bc853f20-aa89-4b7b-9820-ea98592cad16 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:18.542247 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bc853f20-aa89-4b7b-9820-ea98592cad16 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:18.570277 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-bc853f20-aa89-4b7b-9820-ea98592cad16 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Going to try to terminate instance {{(pid=127648) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:50:18.649858 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-bc853f20-aa89-4b7b-9820-ea98592cad16 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "DELETE /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 204 len: 0 microversion: 2.1 time: 0.128300 Nov 02 16:50:18.651112 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 317/656] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:50:18 2021] DELETE /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:50:18.661341 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4c34e35c-8ba1-4b47-9cb0-0b01efc505de tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:18.662074 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4c34e35c-8ba1-4b47-9cb0-0b01efc505de tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:18.668560 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4c34e35c-8ba1-4b47-9cb0-0b01efc505de tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:18.669022 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4c34e35c-8ba1-4b47-9cb0-0b01efc505de tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:18.669831 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4c34e35c-8ba1-4b47-9cb0-0b01efc505de tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:18.671071 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4c34e35c-8ba1-4b47-9cb0-0b01efc505de tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:18.688692 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-01188c51-6d86-434e-a2f0-ca1c129d9bc3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:18.690256 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-01188c51-6d86-434e-a2f0-ca1c129d9bc3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:18.698586 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-01188c51-6d86-434e-a2f0-ca1c129d9bc3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:18.699061 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-01188c51-6d86-434e-a2f0-ca1c129d9bc3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:18.700047 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-01188c51-6d86-434e-a2f0-ca1c129d9bc3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:18.700546 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-01188c51-6d86-434e-a2f0-ca1c129d9bc3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:18.827850 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-4c34e35c-8ba1-4b47-9cb0-0b01efc505de tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:18.838565 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4c34e35c-8ba1-4b47-9cb0-0b01efc505de tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1518 microversion: 2.1 time: 0.181403 Nov 02 16:50:18.839427 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 340/657] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:18 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:50:18.872486 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-01188c51-6d86-434e-a2f0-ca1c129d9bc3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:18.882241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-01188c51-6d86-434e-a2f0-ca1c129d9bc3 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1511 microversion: 2.1 time: 0.199440 Nov 02 16:50:18.883006 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 318/658] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:18 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1511 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:18.979682 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0b37c43b-42e8-4df4-8baa-6ef56dc121f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:18.980348 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0b37c43b-42e8-4df4-8baa-6ef56dc121f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:18.990839 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b37c43b-42e8-4df4-8baa-6ef56dc121f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:18.991294 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b37c43b-42e8-4df4-8baa-6ef56dc121f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:18.992329 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b37c43b-42e8-4df4-8baa-6ef56dc121f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:18.992771 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0b37c43b-42e8-4df4-8baa-6ef56dc121f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:19.136439 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0b37c43b-42e8-4df4-8baa-6ef56dc121f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:19.145874 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0b37c43b-42e8-4df4-8baa-6ef56dc121f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:19.147419 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0b37c43b-42e8-4df4-8baa-6ef56dc121f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:19.148713 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0b37c43b-42e8-4df4-8baa-6ef56dc121f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.173290 Nov 02 16:50:19.159946 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 341/659] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:18 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:19.193190 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7e700b6a-f138-47dc-b585-15c8c15c1d3b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:19.193824 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7e700b6a-f138-47dc-b585-15c8c15c1d3b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:19.200312 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e700b6a-f138-47dc-b585-15c8c15c1d3b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:19.200785 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e700b6a-f138-47dc-b585-15c8c15c1d3b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:19.202276 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e700b6a-f138-47dc-b585-15c8c15c1d3b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:19.202999 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e700b6a-f138-47dc-b585-15c8c15c1d3b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:19.432630 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7e700b6a-f138-47dc-b585-15c8c15c1d3b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:19.441877 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7e700b6a-f138-47dc-b585-15c8c15c1d3b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1704 microversion: 2.1 time: 0.252807 Nov 02 16:50:19.442526 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 319/660] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:19 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1704 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:19.461462 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-daf49215-567a-4cb7-8ef0-c196079e5dac tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:19.468687 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-daf49215-567a-4cb7-8ef0-c196079e5dac tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:19.469238 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-daf49215-567a-4cb7-8ef0-c196079e5dac tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:19.494903 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-daf49215-567a-4cb7-8ef0-c196079e5dac tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Going to try to start instance {{(pid=127649) start /opt/stack/nova/nova/compute/api.py:2675}} Nov 02 16:50:19.564632 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-daf49215-567a-4cb7-8ef0-c196079e5dac tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 202 len: 0 microversion: 2.1 time: 0.107172 Nov 02 16:50:19.568602 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 342/661] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:50:19 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:50:19.579670 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-29145f18-7bbf-49cc-9e1f-32cdab66da63 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:19.581342 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-29145f18-7bbf-49cc-9e1f-32cdab66da63 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:19.583746 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-7f2029ba-a5b6-4e47-baf6-e10474632cb4 req-1419e195-1e0c-48fe-996e-0eb042e912be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17da9bbd-fb82-4abe-a41e-4edac4b87bc7", "name": "network-vif-deleted", "tag": "4c21c6a5-6c5e-47dc-9609-26483e9e33f3"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:19.592983 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:50:19.592983 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:50:19.593461 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-29145f18-7bbf-49cc-9e1f-32cdab66da63 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:19.593461 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-29145f18-7bbf-49cc-9e1f-32cdab66da63 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:19.594253 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-29145f18-7bbf-49cc-9e1f-32cdab66da63 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:19.594705 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-29145f18-7bbf-49cc-9e1f-32cdab66da63 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:19.624838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-7f2029ba-a5b6-4e47-baf6-e10474632cb4 req-1419e195-1e0c-48fe-996e-0eb042e912be service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:19.626154 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-7f2029ba-a5b6-4e47-baf6-e10474632cb4 req-1419e195-1e0c-48fe-996e-0eb042e912be service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:19.641994 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-7f2029ba-a5b6-4e47-baf6-e10474632cb4 req-1419e195-1e0c-48fe-996e-0eb042e912be service nova] Creating event network-vif-deleted:4c21c6a5-6c5e-47dc-9609-26483e9e33f3 for instance 17da9bbd-fb82-4abe-a41e-4edac4b87bc7 on hv-cinder-77387 Nov 02 16:50:19.648364 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-7f2029ba-a5b6-4e47-baf6-e10474632cb4 req-1419e195-1e0c-48fe-996e-0eb042e912be service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082263 Nov 02 16:50:19.652890 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 320/662] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:50:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:19.782988 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-29145f18-7bbf-49cc-9e1f-32cdab66da63 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:19.792072 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-29145f18-7bbf-49cc-9e1f-32cdab66da63 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1713 microversion: 2.1 time: 0.220745 Nov 02 16:50:19.792770 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 343/663] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:19 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1713 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:19.859936 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-46eaf841-cc7d-413c-b609-4e08f5553ca1 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:19.860649 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-46eaf841-cc7d-413c-b609-4e08f5553ca1 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:19.868046 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-46eaf841-cc7d-413c-b609-4e08f5553ca1 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:19.868586 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-46eaf841-cc7d-413c-b609-4e08f5553ca1 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:19.869343 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-46eaf841-cc7d-413c-b609-4e08f5553ca1 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:19.869786 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-46eaf841-cc7d-413c-b609-4e08f5553ca1 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:19.901731 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9bc9a7dc-ebec-4b7d-b9ef-3fe2be02897d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:19.902364 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9bc9a7dc-ebec-4b7d-b9ef-3fe2be02897d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:19.909647 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bc9a7dc-ebec-4b7d-b9ef-3fe2be02897d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:19.910108 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bc9a7dc-ebec-4b7d-b9ef-3fe2be02897d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:19.911002 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bc9a7dc-ebec-4b7d-b9ef-3fe2be02897d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:19.911356 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bc9a7dc-ebec-4b7d-b9ef-3fe2be02897d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:19.950096 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bc9a7dc-ebec-4b7d-b9ef-3fe2be02897d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:19.950555 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bc9a7dc-ebec-4b7d-b9ef-3fe2be02897d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:19.951024 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-9bc9a7dc-ebec-4b7d-b9ef-3fe2be02897d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lazy-loading 'fault' on Instance uuid 17da9bbd-fb82-4abe-a41e-4edac4b87bc7 {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:50:20.001898 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-9bc9a7dc-ebec-4b7d-b9ef-3fe2be02897d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:20.010731 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9bc9a7dc-ebec-4b7d-b9ef-3fe2be02897d tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 200 len: 1315 microversion: 2.1 time: 0.113003 Nov 02 16:50:20.012025 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 344/664] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:19 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 1315 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:50:20.141967 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-46eaf841-cc7d-413c-b609-4e08f5553ca1 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:20.150696 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-46eaf841-cc7d-413c-b609-4e08f5553ca1 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1518 microversion: 2.1 time: 0.296663 Nov 02 16:50:20.151351 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 321/665] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:19 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1518 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:20.167362 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b4c437b5-27a1-4aa4-887b-121eb4273ca5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:20.168139 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b4c437b5-27a1-4aa4-887b-121eb4273ca5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:20.176191 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b4c437b5-27a1-4aa4-887b-121eb4273ca5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:20.176711 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b4c437b5-27a1-4aa4-887b-121eb4273ca5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:20.177550 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b4c437b5-27a1-4aa4-887b-121eb4273ca5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:20.178002 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b4c437b5-27a1-4aa4-887b-121eb4273ca5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:20.324352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b4c437b5-27a1-4aa4-887b-121eb4273ca5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:20.334631 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b4c437b5-27a1-4aa4-887b-121eb4273ca5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:20.336258 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b4c437b5-27a1-4aa4-887b-121eb4273ca5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:20.337725 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b4c437b5-27a1-4aa4-887b-121eb4273ca5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1749 microversion: 2.20 time: 0.174596 Nov 02 16:50:20.338830 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 345/666] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:20 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:20.811365 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2bc2dae4-9e2e-485d-a399-ff5a7b5389ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:20.812007 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2bc2dae4-9e2e-485d-a399-ff5a7b5389ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:20.818992 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2bc2dae4-9e2e-485d-a399-ff5a7b5389ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:20.819458 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2bc2dae4-9e2e-485d-a399-ff5a7b5389ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:20.820305 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2bc2dae4-9e2e-485d-a399-ff5a7b5389ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:20.820752 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2bc2dae4-9e2e-485d-a399-ff5a7b5389ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:20.972486 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2bc2dae4-9e2e-485d-a399-ff5a7b5389ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:20.981428 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2bc2dae4-9e2e-485d-a399-ff5a7b5389ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1713 microversion: 2.1 time: 0.174165 Nov 02 16:50:20.982210 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 322/667] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:20 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1713 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:21.029660 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5ef64872-3f10-4af6-af3a-4fc44ec2dbac tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:21.030785 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5ef64872-3f10-4af6-af3a-4fc44ec2dbac tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 17da9bbd-fb82-4abe-a41e-4edac4b87bc7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:21.037797 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ef64872-3f10-4af6-af3a-4fc44ec2dbac tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:21.038278 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ef64872-3f10-4af6-af3a-4fc44ec2dbac tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:21.039125 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ef64872-3f10-4af6-af3a-4fc44ec2dbac tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:21.039563 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ef64872-3f10-4af6-af3a-4fc44ec2dbac tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:21.055183 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-5ef64872-3f10-4af6-af3a-4fc44ec2dbac tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] HTTP exception thrown: Instance 17da9bbd-fb82-4abe-a41e-4edac4b87bc7 could not be found. Nov 02 16:50:21.055841 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5ef64872-3f10-4af6-af3a-4fc44ec2dbac tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Returning 404 to user: Instance 17da9bbd-fb82-4abe-a41e-4edac4b87bc7 could not be found. {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:50:21.056816 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5ef64872-3f10-4af6-af3a-4fc44ec2dbac tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7" status: 404 len: 111 microversion: 2.1 time: 0.031581 Nov 02 16:50:21.057469 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 346/668] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:21 2021] GET /compute/v2.1/servers/17da9bbd-fb82-4abe-a41e-4edac4b87bc7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:50:21.067699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4592b7c1-e4c0-4ddf-a372-c7b279687d72 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:21.068093 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4592b7c1-e4c0-4ddf-a372-c7b279687d72 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:21.075283 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4592b7c1-e4c0-4ddf-a372-c7b279687d72 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:21.075876 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4592b7c1-e4c0-4ddf-a372-c7b279687d72 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:21.077302 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4592b7c1-e4c0-4ddf-a372-c7b279687d72 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:21.077752 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4592b7c1-e4c0-4ddf-a372-c7b279687d72 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:21.105697 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4592b7c1-e4c0-4ddf-a372-c7b279687d72 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Going to try to terminate instance {{(pid=127648) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:50:21.170568 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b522718f-10d9-472f-825e-739d56f9e55d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:21.171379 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b522718f-10d9-472f-825e-739d56f9e55d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:21.183994 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b522718f-10d9-472f-825e-739d56f9e55d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:21.184493 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b522718f-10d9-472f-825e-739d56f9e55d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:21.186606 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b522718f-10d9-472f-825e-739d56f9e55d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:21.186606 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b522718f-10d9-472f-825e-739d56f9e55d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:21.196233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4592b7c1-e4c0-4ddf-a372-c7b279687d72 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "DELETE /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 204 len: 0 microversion: 2.1 time: 0.132662 Nov 02 16:50:21.197385 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 323/669] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:50:21 2021] DELETE /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:50:21.208221 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-8fccc1f9-a54e-4610-83b5-338fe5d78803 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:21.209105 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8fccc1f9-a54e-4610-83b5-338fe5d78803 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:21.217004 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8fccc1f9-a54e-4610-83b5-338fe5d78803 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:21.217467 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8fccc1f9-a54e-4610-83b5-338fe5d78803 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:21.218364 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8fccc1f9-a54e-4610-83b5-338fe5d78803 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:21.218949 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8fccc1f9-a54e-4610-83b5-338fe5d78803 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:21.364527 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b522718f-10d9-472f-825e-739d56f9e55d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:21.374116 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b522718f-10d9-472f-825e-739d56f9e55d tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1518 microversion: 2.1 time: 0.207596 Nov 02 16:50:21.374822 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 347/670] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:21 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1518 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:21.380578 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2bb20a9a-7287-4d58-8899-d39bfd75ab48 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:21.381799 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2bb20a9a-7287-4d58-8899-d39bfd75ab48 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:21.388859 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2bb20a9a-7287-4d58-8899-d39bfd75ab48 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:21.389333 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2bb20a9a-7287-4d58-8899-d39bfd75ab48 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:21.390230 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2bb20a9a-7287-4d58-8899-d39bfd75ab48 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:21.390766 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2bb20a9a-7287-4d58-8899-d39bfd75ab48 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:21.397775 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-8fccc1f9-a54e-4610-83b5-338fe5d78803 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:21.406740 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-8fccc1f9-a54e-4610-83b5-338fe5d78803 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.203232 Nov 02 16:50:21.407742 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 324/671] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:21 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:50:21.567421 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2bb20a9a-7287-4d58-8899-d39bfd75ab48 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:21.577307 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2bb20a9a-7287-4d58-8899-d39bfd75ab48 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:21.579051 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2bb20a9a-7287-4d58-8899-d39bfd75ab48 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:21.580307 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2bb20a9a-7287-4d58-8899-d39bfd75ab48 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1749 microversion: 2.20 time: 0.203887 Nov 02 16:50:21.580957 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 348/672] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:21 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1749 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:22.040665 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-376825da-b84c-443f-a33c-d8b6f922b9e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:22.041435 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-376825da-b84c-443f-a33c-d8b6f922b9e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:22.049338 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-376825da-b84c-443f-a33c-d8b6f922b9e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:22.049807 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-376825da-b84c-443f-a33c-d8b6f922b9e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:22.050780 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-376825da-b84c-443f-a33c-d8b6f922b9e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:22.051078 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-376825da-b84c-443f-a33c-d8b6f922b9e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:22.156594 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-a1e46878-ecd3-4c0b-bafd-8afd07177a1c req-696c48a8-dfdb-4f89-83b9-053b8c5798d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e699b34f-97c8-4316-9e80-4820d1f94e26", "name": "network-vif-deleted", "tag": "6d3bae71-e514-49ab-9222-9632d4fba0f5"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:22.159268 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:50:22.159268 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:50:22.168239 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-a1e46878-ecd3-4c0b-bafd-8afd07177a1c req-696c48a8-dfdb-4f89-83b9-053b8c5798d5 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:22.168688 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-a1e46878-ecd3-4c0b-bafd-8afd07177a1c req-696c48a8-dfdb-4f89-83b9-053b8c5798d5 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:22.183322 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-a1e46878-ecd3-4c0b-bafd-8afd07177a1c req-696c48a8-dfdb-4f89-83b9-053b8c5798d5 service nova] Creating event network-vif-deleted:6d3bae71-e514-49ab-9222-9632d4fba0f5 for instance e699b34f-97c8-4316-9e80-4820d1f94e26 on hv-cinder-77387 Nov 02 16:50:22.189986 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-a1e46878-ecd3-4c0b-bafd-8afd07177a1c req-696c48a8-dfdb-4f89-83b9-053b8c5798d5 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038677 Nov 02 16:50:22.192388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 349/673] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:50:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:50:22.258549 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-376825da-b84c-443f-a33c-d8b6f922b9e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:22.270862 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-376825da-b84c-443f-a33c-d8b6f922b9e9 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1717 microversion: 2.1 time: 0.234386 Nov 02 16:50:22.271861 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 325/674] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:22 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1717 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:22.392593 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fc7415c9-1b12-4e65-8fc9-350f0e7aeb34 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:22.393323 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fc7415c9-1b12-4e65-8fc9-350f0e7aeb34 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:22.401398 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc7415c9-1b12-4e65-8fc9-350f0e7aeb34 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:22.401872 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc7415c9-1b12-4e65-8fc9-350f0e7aeb34 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:22.402703 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc7415c9-1b12-4e65-8fc9-350f0e7aeb34 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:22.403149 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc7415c9-1b12-4e65-8fc9-350f0e7aeb34 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:22.425862 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-8c23ec6d-afe8-4c43-b76e-0552b95439a0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:22.426514 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8c23ec6d-afe8-4c43-b76e-0552b95439a0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:22.433382 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8c23ec6d-afe8-4c43-b76e-0552b95439a0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:22.434522 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8c23ec6d-afe8-4c43-b76e-0552b95439a0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:22.436250 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8c23ec6d-afe8-4c43-b76e-0552b95439a0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:22.436936 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8c23ec6d-afe8-4c43-b76e-0552b95439a0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:22.441086 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc7415c9-1b12-4e65-8fc9-350f0e7aeb34 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:22.441638 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc7415c9-1b12-4e65-8fc9-350f0e7aeb34 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:22.442189 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-fc7415c9-1b12-4e65-8fc9-350f0e7aeb34 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lazy-loading 'fault' on Instance uuid e699b34f-97c8-4316-9e80-4820d1f94e26 {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:50:22.491231 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-fc7415c9-1b12-4e65-8fc9-350f0e7aeb34 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f09374d85e441bea89376debca253d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd124bfe873f4553b53c6d8282df462c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:22.502252 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fc7415c9-1b12-4e65-8fc9-350f0e7aeb34 tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 200 len: 1312 microversion: 2.1 time: 0.114080 Nov 02 16:50:22.512516 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 350/675] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:22 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:22.600043 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e76037bc-02be-4b65-8256-84cb32d0dec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:22.600845 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e76037bc-02be-4b65-8256-84cb32d0dec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:22.610626 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e76037bc-02be-4b65-8256-84cb32d0dec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:22.611675 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e76037bc-02be-4b65-8256-84cb32d0dec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:22.613247 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e76037bc-02be-4b65-8256-84cb32d0dec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:22.614147 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e76037bc-02be-4b65-8256-84cb32d0dec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:22.623662 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-8c23ec6d-afe8-4c43-b76e-0552b95439a0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:22.641253 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-8c23ec6d-afe8-4c43-b76e-0552b95439a0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.219761 Nov 02 16:50:22.642052 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 326/676] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:22 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:50:22.791631 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e76037bc-02be-4b65-8256-84cb32d0dec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:22.805702 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e76037bc-02be-4b65-8256-84cb32d0dec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:22.807141 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e76037bc-02be-4b65-8256-84cb32d0dec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:22.808480 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e76037bc-02be-4b65-8256-84cb32d0dec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1744 microversion: 2.20 time: 0.213029 Nov 02 16:50:22.809122 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 351/677] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:22 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1744 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:23.520861 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-605fe362-ed88-4029-9b65-1f4f5dec38bb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:23.522314 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-605fe362-ed88-4029-9b65-1f4f5dec38bb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] [instance: e699b34f-97c8-4316-9e80-4820d1f94e26] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:23.536084 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-605fe362-ed88-4029-9b65-1f4f5dec38bb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:23.536950 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-605fe362-ed88-4029-9b65-1f4f5dec38bb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:23.537980 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-605fe362-ed88-4029-9b65-1f4f5dec38bb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:23.538606 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-605fe362-ed88-4029-9b65-1f4f5dec38bb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:23.558599 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-605fe362-ed88-4029-9b65-1f4f5dec38bb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] HTTP exception thrown: Instance e699b34f-97c8-4316-9e80-4820d1f94e26 could not be found. Nov 02 16:50:23.559760 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-605fe362-ed88-4029-9b65-1f4f5dec38bb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] Returning 404 to user: Instance e699b34f-97c8-4316-9e80-4820d1f94e26 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:50:23.561761 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-605fe362-ed88-4029-9b65-1f4f5dec38bb tempest-AttachVolumeNegativeTest-1422631423 tempest-AttachVolumeNegativeTest-1422631423-project] 10.222.0.118 "GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26" status: 404 len: 111 microversion: 2.1 time: 0.045688 Nov 02 16:50:23.577901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 327/678] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:23 2021] GET /compute/v2.1/servers/e699b34f-97c8-4316-9e80-4820d1f94e26 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:50:23.664040 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a0bb8eb0-f90f-4a14-ac38-98d04198e81c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:23.666674 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a0bb8eb0-f90f-4a14-ac38-98d04198e81c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:23.675595 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0bb8eb0-f90f-4a14-ac38-98d04198e81c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:23.676688 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0bb8eb0-f90f-4a14-ac38-98d04198e81c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:23.677819 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0bb8eb0-f90f-4a14-ac38-98d04198e81c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:23.678495 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0bb8eb0-f90f-4a14-ac38-98d04198e81c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:23.830761 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-342403b5-c815-430b-80ed-8a75bdc3b64a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:23.831412 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-342403b5-c815-430b-80ed-8a75bdc3b64a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:23.849915 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-342403b5-c815-430b-80ed-8a75bdc3b64a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:23.850831 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-342403b5-c815-430b-80ed-8a75bdc3b64a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:23.856349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-342403b5-c815-430b-80ed-8a75bdc3b64a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:23.864627 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-342403b5-c815-430b-80ed-8a75bdc3b64a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:24.156583 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a0bb8eb0-f90f-4a14-ac38-98d04198e81c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:24.174018 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a0bb8eb0-f90f-4a14-ac38-98d04198e81c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.517620 Nov 02 16:50:24.186504 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-342403b5-c815-430b-80ed-8a75bdc3b64a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:24.187513 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 352/679] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:23 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:24.201946 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-342403b5-c815-430b-80ed-8a75bdc3b64a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:24.208597 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-342403b5-c815-430b-80ed-8a75bdc3b64a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:24.211516 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-342403b5-c815-430b-80ed-8a75bdc3b64a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1744 microversion: 2.20 time: 0.386811 Nov 02 16:50:24.224760 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 328/680] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:23 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1744 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:50:25.194320 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-de05c63f-7ead-4c88-8ba3-368cc7f3a92c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:25.198466 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-de05c63f-7ead-4c88-8ba3-368cc7f3a92c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:25.208167 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-de05c63f-7ead-4c88-8ba3-368cc7f3a92c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:25.209081 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-de05c63f-7ead-4c88-8ba3-368cc7f3a92c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:25.210136 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-de05c63f-7ead-4c88-8ba3-368cc7f3a92c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:25.210963 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-de05c63f-7ead-4c88-8ba3-368cc7f3a92c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:25.232320 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ce663e36-42e3-4382-95b3-5bac17b93e19 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:25.235235 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ce663e36-42e3-4382-95b3-5bac17b93e19 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:25.256861 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ce663e36-42e3-4382-95b3-5bac17b93e19 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:25.260681 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ce663e36-42e3-4382-95b3-5bac17b93e19 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:25.264685 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ce663e36-42e3-4382-95b3-5bac17b93e19 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:25.269314 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ce663e36-42e3-4382-95b3-5bac17b93e19 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:25.607645 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-de05c63f-7ead-4c88-8ba3-368cc7f3a92c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:25.625685 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-de05c63f-7ead-4c88-8ba3-368cc7f3a92c tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.435455 Nov 02 16:50:25.627206 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 353/681] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:25 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:25.702893 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ce663e36-42e3-4382-95b3-5bac17b93e19 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:25.716290 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ce663e36-42e3-4382-95b3-5bac17b93e19 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:25.718664 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ce663e36-42e3-4382-95b3-5bac17b93e19 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:25.736966 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ce663e36-42e3-4382-95b3-5bac17b93e19 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1744 microversion: 2.20 time: 0.507916 Nov 02 16:50:25.753159 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 329/682] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:25 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1744 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:25.944346 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-163b5412-7496-47c7-961d-459834912a41 req-1b0ed4f1-8f20-40a3-b3a9-9347bb2c885a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df0bde8-504d-42f2-b162-1fb601b26528", "name": "network-vif-plugged", "status": "completed", "tag": "6a36918e-caa7-42ed-b923-c3a049049148"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:25.950637 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:50:25.950637 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:50:26.003922 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-163b5412-7496-47c7-961d-459834912a41 req-1b0ed4f1-8f20-40a3-b3a9-9347bb2c885a service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:26.005389 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-163b5412-7496-47c7-961d-459834912a41 req-1b0ed4f1-8f20-40a3-b3a9-9347bb2c885a service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:26.033904 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-163b5412-7496-47c7-961d-459834912a41 req-1b0ed4f1-8f20-40a3-b3a9-9347bb2c885a service nova] Creating event network-vif-plugged:6a36918e-caa7-42ed-b923-c3a049049148 for instance 3df0bde8-504d-42f2-b162-1fb601b26528 on hv-cinder-77387 Nov 02 16:50:26.100674 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-163b5412-7496-47c7-961d-459834912a41 req-1b0ed4f1-8f20-40a3-b3a9-9347bb2c885a service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188861 Nov 02 16:50:26.101718 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 354/683] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:50:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:26.661284 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-970e90e9-fbf5-4de7-b185-4193f956f900 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:26.664376 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-970e90e9-fbf5-4de7-b185-4193f956f900 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:26.674150 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-970e90e9-fbf5-4de7-b185-4193f956f900 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:26.674953 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-970e90e9-fbf5-4de7-b185-4193f956f900 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:26.676720 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-970e90e9-fbf5-4de7-b185-4193f956f900 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:26.677422 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-970e90e9-fbf5-4de7-b185-4193f956f900 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:26.762481 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5cb29843-b915-4dbe-83a0-cf367c6f177d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:26.781892 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5cb29843-b915-4dbe-83a0-cf367c6f177d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:26.790063 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5cb29843-b915-4dbe-83a0-cf367c6f177d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:26.790533 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5cb29843-b915-4dbe-83a0-cf367c6f177d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:26.791660 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5cb29843-b915-4dbe-83a0-cf367c6f177d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:26.792378 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5cb29843-b915-4dbe-83a0-cf367c6f177d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:27.037560 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-970e90e9-fbf5-4de7-b185-4193f956f900 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:27.057006 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-970e90e9-fbf5-4de7-b185-4193f956f900 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.407555 Nov 02 16:50:27.058412 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 330/684] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:26 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:27.159663 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5cb29843-b915-4dbe-83a0-cf367c6f177d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:27.174670 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5cb29843-b915-4dbe-83a0-cf367c6f177d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:27.176403 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5cb29843-b915-4dbe-83a0-cf367c6f177d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:27.177853 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5cb29843-b915-4dbe-83a0-cf367c6f177d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1744 microversion: 2.20 time: 0.421103 Nov 02 16:50:27.178622 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 355/685] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:26 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1744 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:27.411010 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0e6d0fd0-2441-4727-a913-9ad306d77acc tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] Action: 'create', calling method: .version_select at 0x7f112ee4e3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-772363497", "metadata": {"Type": "work"}}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:27.413820 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0e6d0fd0-2441-4727-a913-9ad306d77acc tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:50:27.415330 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0e6d0fd0-2441-4727-a913-9ad306d77acc tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] 10.222.0.118 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.330868 Nov 02 16:50:27.416200 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 331/686] 10.222.0.118 () {60 vars in 1160 bytes} [Tue Nov 2 16:50:27 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 333 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 16:50:27.427425 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3336c09a-570e-4d89-acee-c455196c386c tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] Action: 'create', calling method: .version_select at 0x7f113403a9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1063078240", "metadata": {"Type": "work"}}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:27.428986 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3336c09a-570e-4d89-acee-c455196c386c tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:50:27.429895 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3336c09a-570e-4d89-acee-c455196c386c tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] 10.222.0.118 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006953 Nov 02 16:50:27.430540 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 356/687] 10.222.0.118 () {60 vars in 1160 bytes} [Tue Nov 2 16:50:27 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 16:50:27.446352 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0fd9788c-f1c6-402d-af62-a719042db1ba tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] Action: 'create', calling method: .version_select at 0x7f112ed9d1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-386903669", "metadata": {"Type": "work"}}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:27.447872 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0fd9788c-f1c6-402d-af62-a719042db1ba tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:50:27.449068 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0fd9788c-f1c6-402d-af62-a719042db1ba tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] 10.222.0.118 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011195 Nov 02 16:50:27.455630 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 332/688] 10.222.0.118 () {60 vars in 1160 bytes} [Tue Nov 2 16:50:27 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 16:50:27.461271 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f27adfb7-050a-4129-b4bc-f2d7860c62fe tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] Calling method '.version_select at 0x7f112f43f4c0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:27.498490 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-f27adfb7-050a-4129-b4bc-f2d7860c62fe tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] HTTP exception thrown: Volume tempest-invalid-1372009906 could not be found. Nov 02 16:50:27.500065 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f27adfb7-050a-4129-b4bc-f2d7860c62fe tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] Returning 404 to user: Volume tempest-invalid-1372009906 could not be found. {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:50:27.501255 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f27adfb7-050a-4129-b4bc-f2d7860c62fe tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] 10.222.0.118 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1372009906" status: 404 len: 99 microversion: 2.1 time: 0.044064 Nov 02 16:50:27.502365 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 357/689] 10.222.0.118 () {58 vars in 1222 bytes} [Tue Nov 2 16:50:27 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1372009906 => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 16:50:27.516377 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-60f74c8c-d894-4ac9-b0c3-7b9138ee6044 tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] 10.222.0.118 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006939 Nov 02 16:50:27.517274 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 333/690] 10.222.0.118 () {58 vars in 1144 bytes} [Tue Nov 2 16:50:27 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 16:50:27.536243 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-37e082ad-e481-4a16-b85d-2167be272552 tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011016 Nov 02 16:50:27.539133 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 358/691] 10.222.0.118 () {58 vars in 1141 bytes} [Tue Nov 2 16:50:27 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 16:50:27.553048 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-66c6a984-8c70-44ca-a002-70cc2f59e987 tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] Calling method '.version_select at 0x7f112ee4eee0>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:27.602137 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-66c6a984-8c70-44ca-a002-70cc2f59e987 tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] HTTP exception thrown: Volume 07e3e53b-d7ca-42eb-a4e3-c0639052f99e could not be found. Nov 02 16:50:27.602830 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-66c6a984-8c70-44ca-a002-70cc2f59e987 tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] Returning 404 to user: Volume 07e3e53b-d7ca-42eb-a4e3-c0639052f99e could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:50:27.603763 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-66c6a984-8c70-44ca-a002-70cc2f59e987 tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] 10.222.0.118 "DELETE /compute/v2.1/os-volumes/07e3e53b-d7ca-42eb-a4e3-c0639052f99e" status: 404 len: 109 microversion: 2.1 time: 0.059000 Nov 02 16:50:27.604448 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 334/692] 10.222.0.118 () {58 vars in 1252 bytes} [Tue Nov 2 16:50:27 2021] DELETE /compute/v2.1/os-volumes/07e3e53b-d7ca-42eb-a4e3-c0639052f99e => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:50:27.615786 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e8249390-e423-4bc6-8ac1-38ad3b40a8b7 tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] Calling method '.version_select at 0x7f113403a9d0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:27.662921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-e8249390-e423-4bc6-8ac1-38ad3b40a8b7 tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] HTTP exception thrown: Volume 83e506da-b60a-432d-8d4a-6f2d9b7f426b could not be found. Nov 02 16:50:27.664081 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e8249390-e423-4bc6-8ac1-38ad3b40a8b7 tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] Returning 404 to user: Volume 83e506da-b60a-432d-8d4a-6f2d9b7f426b could not be found. {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:50:27.665798 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e8249390-e423-4bc6-8ac1-38ad3b40a8b7 tempest-VolumesNegativeTest-374702825 tempest-VolumesNegativeTest-374702825-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/83e506da-b60a-432d-8d4a-6f2d9b7f426b" status: 404 len: 109 microversion: 2.1 time: 0.054010 Nov 02 16:50:27.666663 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 359/693] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:50:27 2021] GET /compute/v2.1/os-volumes/83e506da-b60a-432d-8d4a-6f2d9b7f426b => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:50:28.090253 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7e4e3bc2-e357-4e15-9e18-2274c338e778 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:28.094502 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7e4e3bc2-e357-4e15-9e18-2274c338e778 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:28.115780 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e4e3bc2-e357-4e15-9e18-2274c338e778 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:28.116695 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e4e3bc2-e357-4e15-9e18-2274c338e778 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:28.117837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e4e3bc2-e357-4e15-9e18-2274c338e778 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:28.118283 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e4e3bc2-e357-4e15-9e18-2274c338e778 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:28.208460 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2a56f789-2521-439e-9aba-28264c82a926 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:28.210059 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2a56f789-2521-439e-9aba-28264c82a926 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:28.221033 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2a56f789-2521-439e-9aba-28264c82a926 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:28.221907 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2a56f789-2521-439e-9aba-28264c82a926 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:28.223015 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2a56f789-2521-439e-9aba-28264c82a926 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:28.224028 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2a56f789-2521-439e-9aba-28264c82a926 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:28.430734 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7e4e3bc2-e357-4e15-9e18-2274c338e778 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:28.445446 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7e4e3bc2-e357-4e15-9e18-2274c338e778 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.363313 Nov 02 16:50:28.446804 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 335/694] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:28 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:28.616585 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2a56f789-2521-439e-9aba-28264c82a926 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:28.632713 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2a56f789-2521-439e-9aba-28264c82a926 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:28.635026 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2a56f789-2521-439e-9aba-28264c82a926 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:28.637408 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2a56f789-2521-439e-9aba-28264c82a926 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1744 microversion: 2.20 time: 0.443375 Nov 02 16:50:28.651205 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 360/695] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:28 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1744 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:29.478675 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4e76d382-3ca2-495e-b3b6-2c152acc3878 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:29.480981 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4e76d382-3ca2-495e-b3b6-2c152acc3878 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:29.502965 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4e76d382-3ca2-495e-b3b6-2c152acc3878 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:29.504354 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4e76d382-3ca2-495e-b3b6-2c152acc3878 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:29.505905 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4e76d382-3ca2-495e-b3b6-2c152acc3878 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:29.506550 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4e76d382-3ca2-495e-b3b6-2c152acc3878 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:29.661235 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6e7e2487-776e-4ec5-9217-a5e2cc62e08c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:29.663722 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6e7e2487-776e-4ec5-9217-a5e2cc62e08c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:29.690567 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6e7e2487-776e-4ec5-9217-a5e2cc62e08c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:29.691667 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6e7e2487-776e-4ec5-9217-a5e2cc62e08c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:29.692813 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6e7e2487-776e-4ec5-9217-a5e2cc62e08c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:29.693487 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6e7e2487-776e-4ec5-9217-a5e2cc62e08c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:29.927019 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4e76d382-3ca2-495e-b3b6-2c152acc3878 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:29.943862 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4e76d382-3ca2-495e-b3b6-2c152acc3878 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1525 microversion: 2.1 time: 0.471766 Nov 02 16:50:29.955478 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 336/696] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:29 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1525 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:30.017445 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6e7e2487-776e-4ec5-9217-a5e2cc62e08c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:30.035234 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6e7e2487-776e-4ec5-9217-a5e2cc62e08c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:30.037113 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6e7e2487-776e-4ec5-9217-a5e2cc62e08c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:30.040046 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6e7e2487-776e-4ec5-9217-a5e2cc62e08c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1744 microversion: 2.20 time: 0.385631 Nov 02 16:50:30.042162 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 361/697] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:29 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1744 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:50:30.831990 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-fc468673-36a0-41a8-9701-2e4865678794 req-432a2f92-8765-410b-972f-a4c6b4e3da49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5b406e-d37d-44b0-bb2f-39532baf3f9e", "name": "network-vif-deleted", "tag": "8c95a943-ceda-4a49-8043-1035f5d14c4a"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:30.833984 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:50:30.833984 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:50:30.853885 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-fc468673-36a0-41a8-9701-2e4865678794 req-432a2f92-8765-410b-972f-a4c6b4e3da49 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:30.854274 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-fc468673-36a0-41a8-9701-2e4865678794 req-432a2f92-8765-410b-972f-a4c6b4e3da49 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:30.884477 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-fc468673-36a0-41a8-9701-2e4865678794 req-432a2f92-8765-410b-972f-a4c6b4e3da49 service nova] Creating event network-vif-deleted:8c95a943-ceda-4a49-8043-1035f5d14c4a for instance 6e5b406e-d37d-44b0-bb2f-39532baf3f9e on hv-cinder-77387 Nov 02 16:50:30.893072 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-fc468673-36a0-41a8-9701-2e4865678794 req-432a2f92-8765-410b-972f-a4c6b4e3da49 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065171 Nov 02 16:50:30.895652 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 337/698] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:50:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:30.971634 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b53a651b-bf95-4aeb-9623-ce76034327fe tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:30.972589 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b53a651b-bf95-4aeb-9623-ce76034327fe tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:30.993328 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b53a651b-bf95-4aeb-9623-ce76034327fe tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:30.994152 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b53a651b-bf95-4aeb-9623-ce76034327fe tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:30.995033 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b53a651b-bf95-4aeb-9623-ce76034327fe tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:30.995478 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b53a651b-bf95-4aeb-9623-ce76034327fe tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:31.041119 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b53a651b-bf95-4aeb-9623-ce76034327fe tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:31.041940 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b53a651b-bf95-4aeb-9623-ce76034327fe tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:31.042772 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-b53a651b-bf95-4aeb-9623-ce76034327fe tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lazy-loading 'fault' on Instance uuid 6e5b406e-d37d-44b0-bb2f-39532baf3f9e {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:50:31.080280 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-995051ab-293a-4552-a221-2bc64400e4fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:31.097384 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-995051ab-293a-4552-a221-2bc64400e4fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:31.103665 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b53a651b-bf95-4aeb-9623-ce76034327fe tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b985f6d342a49579d3afd603881498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a412769a7274d9da389f724f6f4744e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:31.120133 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b53a651b-bf95-4aeb-9623-ce76034327fe tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 200 len: 1315 microversion: 2.1 time: 0.153919 Nov 02 16:50:31.124468 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 362/699] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:30 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:31.134581 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-995051ab-293a-4552-a221-2bc64400e4fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:31.136071 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-995051ab-293a-4552-a221-2bc64400e4fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:31.137966 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-995051ab-293a-4552-a221-2bc64400e4fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:31.139294 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-995051ab-293a-4552-a221-2bc64400e4fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:31.463884 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-995051ab-293a-4552-a221-2bc64400e4fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:31.501115 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-995051ab-293a-4552-a221-2bc64400e4fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:31.503547 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-995051ab-293a-4552-a221-2bc64400e4fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:31.505039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-995051ab-293a-4552-a221-2bc64400e4fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1744 microversion: 2.20 time: 0.444287 Nov 02 16:50:31.506324 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 338/700] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:31 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1744 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:32.150054 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-29c6fa3c-936a-4dec-b802-b6fdc9a86fc0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:32.150904 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-29c6fa3c-936a-4dec-b802-b6fdc9a86fc0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] [instance: 6e5b406e-d37d-44b0-bb2f-39532baf3f9e] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:32.170163 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-29c6fa3c-936a-4dec-b802-b6fdc9a86fc0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:32.171655 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-29c6fa3c-936a-4dec-b802-b6fdc9a86fc0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:32.173625 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-29c6fa3c-936a-4dec-b802-b6fdc9a86fc0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:32.174496 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-29c6fa3c-936a-4dec-b802-b6fdc9a86fc0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:32.193948 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-29c6fa3c-936a-4dec-b802-b6fdc9a86fc0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] HTTP exception thrown: Instance 6e5b406e-d37d-44b0-bb2f-39532baf3f9e could not be found. Nov 02 16:50:32.195367 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-29c6fa3c-936a-4dec-b802-b6fdc9a86fc0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] Returning 404 to user: Instance 6e5b406e-d37d-44b0-bb2f-39532baf3f9e could not be found. {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:50:32.196626 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-29c6fa3c-936a-4dec-b802-b6fdc9a86fc0 tempest-ServerRescueNegativeTestJSON-2133527114 tempest-ServerRescueNegativeTestJSON-2133527114-project] 10.222.0.118 "GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e" status: 404 len: 111 microversion: 2.1 time: 0.052103 Nov 02 16:50:32.198230 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 363/701] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:32 2021] GET /compute/v2.1/servers/6e5b406e-d37d-44b0-bb2f-39532baf3f9e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:50:32.556505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-60469084-68a1-4d74-8e8d-86f4e4e602c7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:32.558308 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-60469084-68a1-4d74-8e8d-86f4e4e602c7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:32.606365 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-60469084-68a1-4d74-8e8d-86f4e4e602c7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:32.608352 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-60469084-68a1-4d74-8e8d-86f4e4e602c7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:32.609629 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-60469084-68a1-4d74-8e8d-86f4e4e602c7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:32.610233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-60469084-68a1-4d74-8e8d-86f4e4e602c7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:33.091821 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-60469084-68a1-4d74-8e8d-86f4e4e602c7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:33.115101 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-60469084-68a1-4d74-8e8d-86f4e4e602c7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:33.124916 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-60469084-68a1-4d74-8e8d-86f4e4e602c7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:33.126459 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-60469084-68a1-4d74-8e8d-86f4e4e602c7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1744 microversion: 2.20 time: 0.602678 Nov 02 16:50:33.148796 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 339/702] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:32 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1744 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:34.215869 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-07560189-b125-493f-b98c-5171007d7c0d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:34.222940 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-07560189-b125-493f-b98c-5171007d7c0d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:34.253188 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-07560189-b125-493f-b98c-5171007d7c0d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:34.253578 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-07560189-b125-493f-b98c-5171007d7c0d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:34.256126 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-07560189-b125-493f-b98c-5171007d7c0d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:34.259718 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-07560189-b125-493f-b98c-5171007d7c0d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:34.531205 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-07560189-b125-493f-b98c-5171007d7c0d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:34.554883 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-07560189-b125-493f-b98c-5171007d7c0d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:34.559406 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-07560189-b125-493f-b98c-5171007d7c0d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:34.562049 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-07560189-b125-493f-b98c-5171007d7c0d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1744 microversion: 2.20 time: 0.357888 Nov 02 16:50:34.563180 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 364/703] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:34 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1744 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:35.597379 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-787a4ef3-955b-432d-bb55-37706e34becf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:35.601412 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-787a4ef3-955b-432d-bb55-37706e34becf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:35.637790 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-787a4ef3-955b-432d-bb55-37706e34becf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:35.643418 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-787a4ef3-955b-432d-bb55-37706e34becf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:35.645519 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-787a4ef3-955b-432d-bb55-37706e34becf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:35.646409 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-787a4ef3-955b-432d-bb55-37706e34becf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:36.085694 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-787a4ef3-955b-432d-bb55-37706e34becf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:36.116004 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-787a4ef3-955b-432d-bb55-37706e34becf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:36.117513 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-787a4ef3-955b-432d-bb55-37706e34becf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:36.118850 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-787a4ef3-955b-432d-bb55-37706e34becf tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1744 microversion: 2.20 time: 0.530122 Nov 02 16:50:36.120015 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 340/704] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:35 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1744 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:50:37.164106 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8b358779-4c18-4d05-98f3-a76a019167ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:37.166152 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8b358779-4c18-4d05-98f3-a76a019167ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:37.187464 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8b358779-4c18-4d05-98f3-a76a019167ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:37.188549 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8b358779-4c18-4d05-98f3-a76a019167ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:37.189803 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8b358779-4c18-4d05-98f3-a76a019167ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:37.190576 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8b358779-4c18-4d05-98f3-a76a019167ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:37.741675 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8b358779-4c18-4d05-98f3-a76a019167ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:37.753351 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8b358779-4c18-4d05-98f3-a76a019167ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:37.755895 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8b358779-4c18-4d05-98f3-a76a019167ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:37.761604 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8b358779-4c18-4d05-98f3-a76a019167ac tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1744 microversion: 2.20 time: 0.601142 Nov 02 16:50:37.764510 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 365/705] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:37 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1744 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:38.789221 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0970cf2b-e183-47e6-9233-057e2ce7a653 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:38.790037 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0970cf2b-e183-47e6-9233-057e2ce7a653 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:38.816545 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0970cf2b-e183-47e6-9233-057e2ce7a653 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:38.817767 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0970cf2b-e183-47e6-9233-057e2ce7a653 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:38.820106 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0970cf2b-e183-47e6-9233-057e2ce7a653 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:38.821024 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0970cf2b-e183-47e6-9233-057e2ce7a653 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:39.254402 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0970cf2b-e183-47e6-9233-057e2ce7a653 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:39.275191 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0970cf2b-e183-47e6-9233-057e2ce7a653 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:39.276843 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0970cf2b-e183-47e6-9233-057e2ce7a653 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:39.278213 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0970cf2b-e183-47e6-9233-057e2ce7a653 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1726 microversion: 2.20 time: 0.498074 Nov 02 16:50:39.279697 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 341/706] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:38 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1726 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:40.338909 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-277dde49-856d-4f17-80c2-45d5e440fdb7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:40.339928 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-277dde49-856d-4f17-80c2-45d5e440fdb7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:40.350223 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-277dde49-856d-4f17-80c2-45d5e440fdb7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:40.350863 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-277dde49-856d-4f17-80c2-45d5e440fdb7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:40.352409 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-277dde49-856d-4f17-80c2-45d5e440fdb7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:40.353153 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-277dde49-856d-4f17-80c2-45d5e440fdb7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:40.559306 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-277dde49-856d-4f17-80c2-45d5e440fdb7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:40.575003 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-277dde49-856d-4f17-80c2-45d5e440fdb7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:40.579404 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-277dde49-856d-4f17-80c2-45d5e440fdb7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:40.582227 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-277dde49-856d-4f17-80c2-45d5e440fdb7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1726 microversion: 2.20 time: 0.260579 Nov 02 16:50:40.583332 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 366/707] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:40 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1726 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:41.611699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d013ad46-a1b2-4461-958e-520758676c14 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:41.612979 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d013ad46-a1b2-4461-958e-520758676c14 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:41.634623 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d013ad46-a1b2-4461-958e-520758676c14 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:41.636743 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d013ad46-a1b2-4461-958e-520758676c14 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:41.640592 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d013ad46-a1b2-4461-958e-520758676c14 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:41.641235 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d013ad46-a1b2-4461-958e-520758676c14 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:41.864442 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d013ad46-a1b2-4461-958e-520758676c14 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:41.876067 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d013ad46-a1b2-4461-958e-520758676c14 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:41.878112 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d013ad46-a1b2-4461-958e-520758676c14 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:41.879496 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d013ad46-a1b2-4461-958e-520758676c14 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1726 microversion: 2.20 time: 0.272059 Nov 02 16:50:41.881024 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 342/708] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:41 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1726 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:41.926542 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-4a669183-1f5f-434e-91a1-9bdfa9f88736 req-46c0a49b-e7c1-4f30-83de-b8e277a82270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df0bde8-504d-42f2-b162-1fb601b26528", "name": "network-vif-unplugged", "status": "completed", "tag": "6a36918e-caa7-42ed-b923-c3a049049148"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:41.929395 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:50:41.929395 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:50:41.941753 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-4a669183-1f5f-434e-91a1-9bdfa9f88736 req-46c0a49b-e7c1-4f30-83de-b8e277a82270 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:41.942797 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-4a669183-1f5f-434e-91a1-9bdfa9f88736 req-46c0a49b-e7c1-4f30-83de-b8e277a82270 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:41.959296 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-4a669183-1f5f-434e-91a1-9bdfa9f88736 req-46c0a49b-e7c1-4f30-83de-b8e277a82270 service nova] Creating event network-vif-unplugged:6a36918e-caa7-42ed-b923-c3a049049148 for instance 3df0bde8-504d-42f2-b162-1fb601b26528 on hv-cinder-77387 Nov 02 16:50:41.966310 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-4a669183-1f5f-434e-91a1-9bdfa9f88736 req-46c0a49b-e7c1-4f30-83de-b8e277a82270 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044501 Nov 02 16:50:41.967770 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 367/709] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:50:41 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:50:42.918759 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5d05b49c-df73-46d7-a062-a58da35899fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:42.920530 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5d05b49c-df73-46d7-a062-a58da35899fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:42.929805 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5d05b49c-df73-46d7-a062-a58da35899fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:42.930494 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5d05b49c-df73-46d7-a062-a58da35899fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:42.931479 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5d05b49c-df73-46d7-a062-a58da35899fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:42.932111 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5d05b49c-df73-46d7-a062-a58da35899fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:43.151042 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5d05b49c-df73-46d7-a062-a58da35899fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:43.162468 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5d05b49c-df73-46d7-a062-a58da35899fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:43.164562 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5d05b49c-df73-46d7-a062-a58da35899fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:43.166722 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5d05b49c-df73-46d7-a062-a58da35899fd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1669 microversion: 2.20 time: 0.258865 Nov 02 16:50:43.167859 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 343/710] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:42 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1669 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:43.188576 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b7c9116e-fed3-48c4-959f-49f8f6d2a644 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5632629-20b3-4b15-8b28-6940308b7a9a"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:43.191304 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b7c9116e-fed3-48c4-959f-49f8f6d2a644 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:43.201815 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7c9116e-fed3-48c4-959f-49f8f6d2a644 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:43.202456 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7c9116e-fed3-48c4-959f-49f8f6d2a644 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:43.203196 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7c9116e-fed3-48c4-959f-49f8f6d2a644 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:43.203653 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7c9116e-fed3-48c4-959f-49f8f6d2a644 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:43.630033 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b7c9116e-fed3-48c4-959f-49f8f6d2a644 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.446955 Nov 02 16:50:43.630789 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 368/711] 10.222.0.118 () {62 vars in 1368 bytes} [Tue Nov 2 16:50:43 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-volume_attachments => generated 188 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:50:43.779408 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cb9f338a-2670-47a7-aa3b-eb985d0000d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:43.779965 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-cb9f338a-2670-47a7-aa3b-eb985d0000d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:43.787281 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cb9f338a-2670-47a7-aa3b-eb985d0000d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:43.787745 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cb9f338a-2670-47a7-aa3b-eb985d0000d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:43.788630 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cb9f338a-2670-47a7-aa3b-eb985d0000d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:43.789309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cb9f338a-2670-47a7-aa3b-eb985d0000d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:43.937301 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-cb9f338a-2670-47a7-aa3b-eb985d0000d6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action" status: 202 len: 0 microversion: 2.20 time: 0.161960 Nov 02 16:50:43.939737 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 344/712] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:50:43 2021] POST /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 16:50:43.951913 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3e981017-0976-4c8b-8292-827c906ca927 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:43.953051 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3e981017-0976-4c8b-8292-827c906ca927 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:43.976000 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3e981017-0976-4c8b-8292-827c906ca927 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:43.976776 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3e981017-0976-4c8b-8292-827c906ca927 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:43.978847 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3e981017-0976-4c8b-8292-827c906ca927 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:43.979543 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3e981017-0976-4c8b-8292-827c906ca927 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:44.284284 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3e981017-0976-4c8b-8292-827c906ca927 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:44.311015 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3e981017-0976-4c8b-8292-827c906ca927 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:44.313695 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3e981017-0976-4c8b-8292-827c906ca927 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:44.315392 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3e981017-0976-4c8b-8292-827c906ca927 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1755 microversion: 2.20 time: 0.369123 Nov 02 16:50:44.318089 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 369/713] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:43 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1755 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:45.347308 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-027f84c4-84e7-4308-9005-cf47a5015826 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:45.348416 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-027f84c4-84e7-4308-9005-cf47a5015826 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:45.357957 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-027f84c4-84e7-4308-9005-cf47a5015826 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:45.358539 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-027f84c4-84e7-4308-9005-cf47a5015826 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:45.360577 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-027f84c4-84e7-4308-9005-cf47a5015826 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:45.361371 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-027f84c4-84e7-4308-9005-cf47a5015826 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:45.615968 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-027f84c4-84e7-4308-9005-cf47a5015826 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:45.634922 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-027f84c4-84e7-4308-9005-cf47a5015826 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:45.637395 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-027f84c4-84e7-4308-9005-cf47a5015826 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:45.639199 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-027f84c4-84e7-4308-9005-cf47a5015826 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1755 microversion: 2.20 time: 0.301409 Nov 02 16:50:45.639869 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 345/714] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:45 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1755 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:46.660268 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-73bf38d1-e328-4750-9402-2aeb8617fc56 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:46.661014 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-73bf38d1-e328-4750-9402-2aeb8617fc56 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:46.671541 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-73bf38d1-e328-4750-9402-2aeb8617fc56 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:46.671541 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-73bf38d1-e328-4750-9402-2aeb8617fc56 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:46.671815 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-73bf38d1-e328-4750-9402-2aeb8617fc56 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:46.672032 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-73bf38d1-e328-4750-9402-2aeb8617fc56 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:46.855096 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-73bf38d1-e328-4750-9402-2aeb8617fc56 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:46.866094 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-73bf38d1-e328-4750-9402-2aeb8617fc56 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:46.867650 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-73bf38d1-e328-4750-9402-2aeb8617fc56 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:46.868942 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-73bf38d1-e328-4750-9402-2aeb8617fc56 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1757 microversion: 2.20 time: 0.213213 Nov 02 16:50:46.869898 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 370/715] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:46 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:47.892287 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1c7dc6bd-cb46-44d7-8a9a-7999559c393d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:47.893202 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1c7dc6bd-cb46-44d7-8a9a-7999559c393d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:47.903029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1c7dc6bd-cb46-44d7-8a9a-7999559c393d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:47.904282 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1c7dc6bd-cb46-44d7-8a9a-7999559c393d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:47.905260 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1c7dc6bd-cb46-44d7-8a9a-7999559c393d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:47.906026 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1c7dc6bd-cb46-44d7-8a9a-7999559c393d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:48.115226 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1c7dc6bd-cb46-44d7-8a9a-7999559c393d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:48.128777 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1c7dc6bd-cb46-44d7-8a9a-7999559c393d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:48.130180 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1c7dc6bd-cb46-44d7-8a9a-7999559c393d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:48.131516 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1c7dc6bd-cb46-44d7-8a9a-7999559c393d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.244867 Nov 02 16:50:48.132154 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 346/716] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:47 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:49.152103 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-59484933-e9bd-4e59-a440-1a7cdafbc46b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:49.154374 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-59484933-e9bd-4e59-a440-1a7cdafbc46b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:49.167917 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-59484933-e9bd-4e59-a440-1a7cdafbc46b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:49.171149 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-59484933-e9bd-4e59-a440-1a7cdafbc46b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:49.182088 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-59484933-e9bd-4e59-a440-1a7cdafbc46b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:49.183055 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-59484933-e9bd-4e59-a440-1a7cdafbc46b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:49.505893 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-59484933-e9bd-4e59-a440-1a7cdafbc46b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:49.533783 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-59484933-e9bd-4e59-a440-1a7cdafbc46b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:49.539608 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-59484933-e9bd-4e59-a440-1a7cdafbc46b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:49.541043 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-59484933-e9bd-4e59-a440-1a7cdafbc46b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.393687 Nov 02 16:50:49.541695 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 371/717] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:49 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:49.650898 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a544f9f5-ff5a-41e4-9eda-b5345b1ea886 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:50:49.652086 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a544f9f5-ff5a-41e4-9eda-b5345b1ea886 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:49.661420 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a544f9f5-ff5a-41e4-9eda-b5345b1ea886 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:49.661956 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a544f9f5-ff5a-41e4-9eda-b5345b1ea886 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:49.663169 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a544f9f5-ff5a-41e4-9eda-b5345b1ea886 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:49.663665 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a544f9f5-ff5a-41e4-9eda-b5345b1ea886 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:49.799087 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a544f9f5-ff5a-41e4-9eda-b5345b1ea886 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "POST /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/action" status: 202 len: 0 microversion: 2.1 time: 0.142413 Nov 02 16:50:49.803836 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 347/718] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:50:49 2021] POST /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:50:49.818797 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-636b564a-6f90-4b6a-ae68-3e9965ad35ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:49.820007 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-636b564a-6f90-4b6a-ae68-3e9965ad35ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:49.831952 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-636b564a-6f90-4b6a-ae68-3e9965ad35ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:49.832738 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-636b564a-6f90-4b6a-ae68-3e9965ad35ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:49.833974 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-636b564a-6f90-4b6a-ae68-3e9965ad35ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:49.834726 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-636b564a-6f90-4b6a-ae68-3e9965ad35ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:50.373029 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-636b564a-6f90-4b6a-ae68-3e9965ad35ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:50.384800 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-636b564a-6f90-4b6a-ae68-3e9965ad35ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1753 microversion: 2.1 time: 0.571553 Nov 02 16:50:50.384800 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 372/719] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:49 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1753 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:50.574800 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-13568d76-e24b-46ce-9349-e975915f00cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:50.575853 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-13568d76-e24b-46ce-9349-e975915f00cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:50.586771 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-13568d76-e24b-46ce-9349-e975915f00cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:50.587242 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-13568d76-e24b-46ce-9349-e975915f00cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:50.588100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-13568d76-e24b-46ce-9349-e975915f00cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:50.588907 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-13568d76-e24b-46ce-9349-e975915f00cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:50.797815 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-13568d76-e24b-46ce-9349-e975915f00cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:50.808333 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-13568d76-e24b-46ce-9349-e975915f00cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:50.814795 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-13568d76-e24b-46ce-9349-e975915f00cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:50.816671 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-13568d76-e24b-46ce-9349-e975915f00cd tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.256244 Nov 02 16:50:50.817993 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 348/720] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:50 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:51.403999 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-d237fcdb-0309-4990-bebd-7fed3807a4c5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:51.404855 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d237fcdb-0309-4990-bebd-7fed3807a4c5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:51.415701 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d237fcdb-0309-4990-bebd-7fed3807a4c5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:51.417158 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d237fcdb-0309-4990-bebd-7fed3807a4c5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:51.418471 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d237fcdb-0309-4990-bebd-7fed3807a4c5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:51.419124 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d237fcdb-0309-4990-bebd-7fed3807a4c5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:51.637354 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-d237fcdb-0309-4990-bebd-7fed3807a4c5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:51.654521 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-d237fcdb-0309-4990-bebd-7fed3807a4c5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1753 microversion: 2.1 time: 0.254245 Nov 02 16:50:51.674997 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 373/721] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:51 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1753 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:51.838865 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-96d8f7e2-e38c-4f40-ab08-b3dbe63693ab tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:51.844568 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-96d8f7e2-e38c-4f40-ab08-b3dbe63693ab tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:51.864515 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-96d8f7e2-e38c-4f40-ab08-b3dbe63693ab tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:51.865912 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-96d8f7e2-e38c-4f40-ab08-b3dbe63693ab tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:51.868359 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-96d8f7e2-e38c-4f40-ab08-b3dbe63693ab tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:51.870121 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-96d8f7e2-e38c-4f40-ab08-b3dbe63693ab tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:52.204410 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-96d8f7e2-e38c-4f40-ab08-b3dbe63693ab tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:52.215024 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-96d8f7e2-e38c-4f40-ab08-b3dbe63693ab tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:52.218464 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-96d8f7e2-e38c-4f40-ab08-b3dbe63693ab tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:52.221823 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-96d8f7e2-e38c-4f40-ab08-b3dbe63693ab tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.387286 Nov 02 16:50:52.221823 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 349/722] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:51 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:52.675428 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a0328067-d5cb-49c4-bc30-7a10b0ba88fb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:52.676337 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a0328067-d5cb-49c4-bc30-7a10b0ba88fb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:52.689352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0328067-d5cb-49c4-bc30-7a10b0ba88fb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:52.689352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0328067-d5cb-49c4-bc30-7a10b0ba88fb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:52.689352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0328067-d5cb-49c4-bc30-7a10b0ba88fb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:52.689352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0328067-d5cb-49c4-bc30-7a10b0ba88fb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:52.899822 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a0328067-d5cb-49c4-bc30-7a10b0ba88fb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:52.929725 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a0328067-d5cb-49c4-bc30-7a10b0ba88fb tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1753 microversion: 2.1 time: 0.258529 Nov 02 16:50:52.948917 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 374/723] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:52 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1753 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:53.253328 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3a695478-35e4-41f2-ab1c-227325fb1cc5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:53.254581 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3a695478-35e4-41f2-ab1c-227325fb1cc5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:53.273730 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a695478-35e4-41f2-ab1c-227325fb1cc5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:53.274182 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a695478-35e4-41f2-ab1c-227325fb1cc5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:53.275112 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a695478-35e4-41f2-ab1c-227325fb1cc5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:53.275570 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a695478-35e4-41f2-ab1c-227325fb1cc5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:53.529265 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3a695478-35e4-41f2-ab1c-227325fb1cc5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:53.552552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3a695478-35e4-41f2-ab1c-227325fb1cc5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:53.552552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3a695478-35e4-41f2-ab1c-227325fb1cc5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:53.552901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3a695478-35e4-41f2-ab1c-227325fb1cc5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.304317 Nov 02 16:50:53.553786 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 350/724] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:53 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:53.956232 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2850389a-6191-4c53-9170-6e9ac62876de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:53.957526 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2850389a-6191-4c53-9170-6e9ac62876de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:53.964643 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2850389a-6191-4c53-9170-6e9ac62876de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:53.965156 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2850389a-6191-4c53-9170-6e9ac62876de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:53.967052 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2850389a-6191-4c53-9170-6e9ac62876de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:53.967756 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2850389a-6191-4c53-9170-6e9ac62876de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:54.277409 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2850389a-6191-4c53-9170-6e9ac62876de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:54.289112 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2850389a-6191-4c53-9170-6e9ac62876de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1753 microversion: 2.1 time: 0.337029 Nov 02 16:50:54.299641 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 375/725] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:53 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1753 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:54.577635 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9fa3531a-1020-47fe-8be2-51ba390b2414 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:54.578343 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9fa3531a-1020-47fe-8be2-51ba390b2414 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:54.595815 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9fa3531a-1020-47fe-8be2-51ba390b2414 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:54.596345 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9fa3531a-1020-47fe-8be2-51ba390b2414 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:54.599667 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9fa3531a-1020-47fe-8be2-51ba390b2414 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:54.600143 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9fa3531a-1020-47fe-8be2-51ba390b2414 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:54.842695 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9fa3531a-1020-47fe-8be2-51ba390b2414 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:54.853708 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9fa3531a-1020-47fe-8be2-51ba390b2414 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:54.856538 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9fa3531a-1020-47fe-8be2-51ba390b2414 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:54.858390 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9fa3531a-1020-47fe-8be2-51ba390b2414 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.286836 Nov 02 16:50:54.859595 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 351/726] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:54 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:55.311488 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1cb07ad0-c593-48bf-95cb-0faa292862d8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:55.312522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1cb07ad0-c593-48bf-95cb-0faa292862d8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:55.320306 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1cb07ad0-c593-48bf-95cb-0faa292862d8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:55.320914 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1cb07ad0-c593-48bf-95cb-0faa292862d8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:55.322035 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1cb07ad0-c593-48bf-95cb-0faa292862d8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:55.322673 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1cb07ad0-c593-48bf-95cb-0faa292862d8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:55.554510 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1cb07ad0-c593-48bf-95cb-0faa292862d8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:55.566583 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1cb07ad0-c593-48bf-95cb-0faa292862d8 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1753 microversion: 2.1 time: 0.259340 Nov 02 16:50:55.580890 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 376/727] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:55 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1753 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:55.889730 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4973065e-ce17-4875-bfb5-a50cce33f860 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:55.890535 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4973065e-ce17-4875-bfb5-a50cce33f860 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:55.904715 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4973065e-ce17-4875-bfb5-a50cce33f860 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:55.905595 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4973065e-ce17-4875-bfb5-a50cce33f860 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:55.906659 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4973065e-ce17-4875-bfb5-a50cce33f860 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:55.907285 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4973065e-ce17-4875-bfb5-a50cce33f860 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:56.138516 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4973065e-ce17-4875-bfb5-a50cce33f860 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:56.162601 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4973065e-ce17-4875-bfb5-a50cce33f860 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:56.164409 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4973065e-ce17-4875-bfb5-a50cce33f860 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:56.165811 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4973065e-ce17-4875-bfb5-a50cce33f860 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.281687 Nov 02 16:50:56.166464 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 352/728] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:55 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:56.596008 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4b902592-3a44-4a9c-b165-2297b0ecb23c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:56.598640 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4b902592-3a44-4a9c-b165-2297b0ecb23c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:56.615608 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4b902592-3a44-4a9c-b165-2297b0ecb23c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:56.616136 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4b902592-3a44-4a9c-b165-2297b0ecb23c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:56.623269 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4b902592-3a44-4a9c-b165-2297b0ecb23c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:56.624036 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4b902592-3a44-4a9c-b165-2297b0ecb23c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:56.890137 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-4b902592-3a44-4a9c-b165-2297b0ecb23c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:56.905793 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4b902592-3a44-4a9c-b165-2297b0ecb23c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1753 microversion: 2.1 time: 0.317906 Nov 02 16:50:56.907636 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 377/729] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:56 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1753 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:57.191140 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d954cd54-2eb1-46ab-9711-d294674db31f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:57.192723 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d954cd54-2eb1-46ab-9711-d294674db31f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:57.201673 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d954cd54-2eb1-46ab-9711-d294674db31f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:57.202120 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d954cd54-2eb1-46ab-9711-d294674db31f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:57.203195 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d954cd54-2eb1-46ab-9711-d294674db31f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:57.203875 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d954cd54-2eb1-46ab-9711-d294674db31f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:57.454118 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d954cd54-2eb1-46ab-9711-d294674db31f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:57.469027 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d954cd54-2eb1-46ab-9711-d294674db31f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:57.471527 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d954cd54-2eb1-46ab-9711-d294674db31f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:57.473138 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d954cd54-2eb1-46ab-9711-d294674db31f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.286963 Nov 02 16:50:57.488241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 353/730] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:57 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:57.926352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9cff330d-86a6-4394-980c-15ea165567e9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:57.927154 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9cff330d-86a6-4394-980c-15ea165567e9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:57.948210 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9cff330d-86a6-4394-980c-15ea165567e9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:57.950376 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9cff330d-86a6-4394-980c-15ea165567e9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:57.951520 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9cff330d-86a6-4394-980c-15ea165567e9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:57.952039 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9cff330d-86a6-4394-980c-15ea165567e9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:58.163605 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-9cff330d-86a6-4394-980c-15ea165567e9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:58.178053 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9cff330d-86a6-4394-980c-15ea165567e9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1753 microversion: 2.1 time: 0.256486 Nov 02 16:50:58.178703 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 378/731] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:57 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1753 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:58.496901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e3ac5677-de60-4cba-bd41-9db75f5acf05 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:58.497975 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e3ac5677-de60-4cba-bd41-9db75f5acf05 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:58.505283 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e3ac5677-de60-4cba-bd41-9db75f5acf05 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:58.506612 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e3ac5677-de60-4cba-bd41-9db75f5acf05 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:58.506612 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e3ac5677-de60-4cba-bd41-9db75f5acf05 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:58.507227 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e3ac5677-de60-4cba-bd41-9db75f5acf05 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:58.737400 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e3ac5677-de60-4cba-bd41-9db75f5acf05 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:58.752793 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e3ac5677-de60-4cba-bd41-9db75f5acf05 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:58.754803 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e3ac5677-de60-4cba-bd41-9db75f5acf05 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:58.756664 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e3ac5677-de60-4cba-bd41-9db75f5acf05 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.264443 Nov 02 16:50:58.757696 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 354/732] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:58 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:50:59.198671 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1166857a-c6ca-4b54-92cd-809e7c04253c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:59.201449 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1166857a-c6ca-4b54-92cd-809e7c04253c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:59.207621 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1166857a-c6ca-4b54-92cd-809e7c04253c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:59.208212 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1166857a-c6ca-4b54-92cd-809e7c04253c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:59.209137 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1166857a-c6ca-4b54-92cd-809e7c04253c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:59.209664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1166857a-c6ca-4b54-92cd-809e7c04253c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:59.467159 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1166857a-c6ca-4b54-92cd-809e7c04253c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:50:59.492937 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1166857a-c6ca-4b54-92cd-809e7c04253c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1753 microversion: 2.1 time: 0.298554 Nov 02 16:50:59.494203 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 379/733] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:50:59 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1753 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:50:59.779399 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-634d0f3e-b025-4ac3-a893-e5ee82e00cb1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:50:59.781495 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-634d0f3e-b025-4ac3-a893-e5ee82e00cb1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:50:59.794926 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-634d0f3e-b025-4ac3-a893-e5ee82e00cb1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:59.795591 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-634d0f3e-b025-4ac3-a893-e5ee82e00cb1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:50:59.796675 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-634d0f3e-b025-4ac3-a893-e5ee82e00cb1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:50:59.797253 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-634d0f3e-b025-4ac3-a893-e5ee82e00cb1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:00.027787 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-634d0f3e-b025-4ac3-a893-e5ee82e00cb1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:00.041594 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-634d0f3e-b025-4ac3-a893-e5ee82e00cb1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:00.041917 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-634d0f3e-b025-4ac3-a893-e5ee82e00cb1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:00.044147 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-634d0f3e-b025-4ac3-a893-e5ee82e00cb1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.269282 Nov 02 16:51:00.047519 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 355/734] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:50:59 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:00.515895 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-15827610-fe60-43ea-a6e8-80202afedb12 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:00.516763 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-15827610-fe60-43ea-a6e8-80202afedb12 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:00.527325 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-15827610-fe60-43ea-a6e8-80202afedb12 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:00.529166 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-15827610-fe60-43ea-a6e8-80202afedb12 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:00.530119 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-15827610-fe60-43ea-a6e8-80202afedb12 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:00.530773 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-15827610-fe60-43ea-a6e8-80202afedb12 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:00.791849 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-15827610-fe60-43ea-a6e8-80202afedb12 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:00.804328 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-15827610-fe60-43ea-a6e8-80202afedb12 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1753 microversion: 2.1 time: 0.294098 Nov 02 16:51:00.805570 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 380/735] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:00 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1753 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:01.066176 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-517a9a67-5968-4e32-9257-ca935614e0fc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:01.067010 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-517a9a67-5968-4e32-9257-ca935614e0fc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:01.087962 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-517a9a67-5968-4e32-9257-ca935614e0fc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:01.089042 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-517a9a67-5968-4e32-9257-ca935614e0fc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:01.090760 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-517a9a67-5968-4e32-9257-ca935614e0fc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:01.091357 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-517a9a67-5968-4e32-9257-ca935614e0fc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:01.296797 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-517a9a67-5968-4e32-9257-ca935614e0fc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:01.319472 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-517a9a67-5968-4e32-9257-ca935614e0fc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:01.324093 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-517a9a67-5968-4e32-9257-ca935614e0fc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:01.326459 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-517a9a67-5968-4e32-9257-ca935614e0fc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.265056 Nov 02 16:51:01.340850 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 356/736] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:01 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:01.831005 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-087be265-8df9-40ef-9808-18a62bb11853 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:01.833802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-087be265-8df9-40ef-9808-18a62bb11853 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:01.847517 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-087be265-8df9-40ef-9808-18a62bb11853 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:01.849526 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-087be265-8df9-40ef-9808-18a62bb11853 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:01.851606 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-087be265-8df9-40ef-9808-18a62bb11853 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:01.852759 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-087be265-8df9-40ef-9808-18a62bb11853 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:02.115251 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-087be265-8df9-40ef-9808-18a62bb11853 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:02.138085 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-087be265-8df9-40ef-9808-18a62bb11853 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1753 microversion: 2.1 time: 0.310472 Nov 02 16:51:02.141812 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 381/737] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:01 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1753 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:02.349021 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-69728b11-3be0-4c8a-8c43-0c4e06c7a368 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:02.351023 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-69728b11-3be0-4c8a-8c43-0c4e06c7a368 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:02.359290 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-69728b11-3be0-4c8a-8c43-0c4e06c7a368 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:02.360151 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-69728b11-3be0-4c8a-8c43-0c4e06c7a368 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:02.367905 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-69728b11-3be0-4c8a-8c43-0c4e06c7a368 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:02.367905 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-69728b11-3be0-4c8a-8c43-0c4e06c7a368 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:02.583930 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-69728b11-3be0-4c8a-8c43-0c4e06c7a368 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:02.600307 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-69728b11-3be0-4c8a-8c43-0c4e06c7a368 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:02.601961 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-69728b11-3be0-4c8a-8c43-0c4e06c7a368 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:02.603297 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-69728b11-3be0-4c8a-8c43-0c4e06c7a368 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.259840 Nov 02 16:51:02.603936 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 357/738] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:02 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:51:03.159317 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1bd87f91-6132-4b9b-b3c4-0303921a13cc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:03.160668 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1bd87f91-6132-4b9b-b3c4-0303921a13cc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:03.167688 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1bd87f91-6132-4b9b-b3c4-0303921a13cc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:03.168766 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1bd87f91-6132-4b9b-b3c4-0303921a13cc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:03.169597 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1bd87f91-6132-4b9b-b3c4-0303921a13cc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:03.170036 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1bd87f91-6132-4b9b-b3c4-0303921a13cc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:03.357225 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1bd87f91-6132-4b9b-b3c4-0303921a13cc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:03.369297 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1bd87f91-6132-4b9b-b3c4-0303921a13cc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1753 microversion: 2.1 time: 0.214502 Nov 02 16:51:03.369954 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 382/739] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:03 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1753 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:51:03.636448 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d0d0c5ed-44a4-4edf-a4ee-2a4107304951 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:03.639598 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d0d0c5ed-44a4-4edf-a4ee-2a4107304951 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:03.649278 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0d0c5ed-44a4-4edf-a4ee-2a4107304951 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:03.649782 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0d0c5ed-44a4-4edf-a4ee-2a4107304951 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:03.650688 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0d0c5ed-44a4-4edf-a4ee-2a4107304951 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:03.651153 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0d0c5ed-44a4-4edf-a4ee-2a4107304951 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:03.939794 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d0d0c5ed-44a4-4edf-a4ee-2a4107304951 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:03.950752 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d0d0c5ed-44a4-4edf-a4ee-2a4107304951 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:03.952552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d0d0c5ed-44a4-4edf-a4ee-2a4107304951 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:03.953951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d0d0c5ed-44a4-4edf-a4ee-2a4107304951 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.323686 Nov 02 16:51:03.954591 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 358/740] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:03 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:04.391238 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-94827170-d465-4761-b5fd-ae1bdc0903dc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:04.392500 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-94827170-d465-4761-b5fd-ae1bdc0903dc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:04.402379 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-94827170-d465-4761-b5fd-ae1bdc0903dc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:04.403606 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-94827170-d465-4761-b5fd-ae1bdc0903dc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:04.404643 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-94827170-d465-4761-b5fd-ae1bdc0903dc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:04.405218 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-94827170-d465-4761-b5fd-ae1bdc0903dc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:04.607563 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-94827170-d465-4761-b5fd-ae1bdc0903dc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:04.618133 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-94827170-d465-4761-b5fd-ae1bdc0903dc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1753 microversion: 2.1 time: 0.234258 Nov 02 16:51:04.618812 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 383/741] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:04 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1753 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:04.979431 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-903efb7d-5f2e-4f9b-8f6d-bb1b5adfda68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:04.980526 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-903efb7d-5f2e-4f9b-8f6d-bb1b5adfda68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:04.988330 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-903efb7d-5f2e-4f9b-8f6d-bb1b5adfda68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:04.989153 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-903efb7d-5f2e-4f9b-8f6d-bb1b5adfda68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:04.990029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-903efb7d-5f2e-4f9b-8f6d-bb1b5adfda68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:04.990484 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-903efb7d-5f2e-4f9b-8f6d-bb1b5adfda68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:05.150449 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-903efb7d-5f2e-4f9b-8f6d-bb1b5adfda68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:05.161218 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-903efb7d-5f2e-4f9b-8f6d-bb1b5adfda68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:05.162720 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-903efb7d-5f2e-4f9b-8f6d-bb1b5adfda68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:05.164051 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-903efb7d-5f2e-4f9b-8f6d-bb1b5adfda68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.189060 Nov 02 16:51:05.164715 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 359/742] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:04 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:05.637692 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-225ff86d-edfd-4c0d-af70-f334629aed0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:05.638475 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-225ff86d-edfd-4c0d-af70-f334629aed0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:05.645664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-225ff86d-edfd-4c0d-af70-f334629aed0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:05.646470 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-225ff86d-edfd-4c0d-af70-f334629aed0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:05.647294 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-225ff86d-edfd-4c0d-af70-f334629aed0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:05.647743 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-225ff86d-edfd-4c0d-af70-f334629aed0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:05.819145 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-225ff86d-edfd-4c0d-af70-f334629aed0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:05.830899 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-225ff86d-edfd-4c0d-af70-f334629aed0e tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.198127 Nov 02 16:51:05.831527 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 384/743] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:05 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:06.186209 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d95283ce-b500-4136-a7ce-feb1d6b5a79a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:06.187111 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d95283ce-b500-4136-a7ce-feb1d6b5a79a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:06.195807 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d95283ce-b500-4136-a7ce-feb1d6b5a79a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:06.196337 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d95283ce-b500-4136-a7ce-feb1d6b5a79a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:06.197196 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d95283ce-b500-4136-a7ce-feb1d6b5a79a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:06.197666 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d95283ce-b500-4136-a7ce-feb1d6b5a79a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:06.387506 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d95283ce-b500-4136-a7ce-feb1d6b5a79a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:06.399165 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d95283ce-b500-4136-a7ce-feb1d6b5a79a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:06.401297 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d95283ce-b500-4136-a7ce-feb1d6b5a79a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:06.403733 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d95283ce-b500-4136-a7ce-feb1d6b5a79a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.223087 Nov 02 16:51:06.405486 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 360/744] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:06 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:06.853634 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3a4c0b99-12b9-49a8-b02a-3951987cd574 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:06.855123 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3a4c0b99-12b9-49a8-b02a-3951987cd574 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:06.863525 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3a4c0b99-12b9-49a8-b02a-3951987cd574 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:06.864045 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3a4c0b99-12b9-49a8-b02a-3951987cd574 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:06.864928 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3a4c0b99-12b9-49a8-b02a-3951987cd574 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:06.865591 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3a4c0b99-12b9-49a8-b02a-3951987cd574 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:07.044707 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3a4c0b99-12b9-49a8-b02a-3951987cd574 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:07.061209 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3a4c0b99-12b9-49a8-b02a-3951987cd574 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.214094 Nov 02 16:51:07.061887 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 385/745] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:06 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:07.425136 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-41e73889-9e04-4d44-9c4c-eb05ca0952f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:07.426040 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-41e73889-9e04-4d44-9c4c-eb05ca0952f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:07.435210 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-41e73889-9e04-4d44-9c4c-eb05ca0952f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:07.435601 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-41e73889-9e04-4d44-9c4c-eb05ca0952f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:07.436586 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-41e73889-9e04-4d44-9c4c-eb05ca0952f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:07.437042 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-41e73889-9e04-4d44-9c4c-eb05ca0952f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:07.639405 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-41e73889-9e04-4d44-9c4c-eb05ca0952f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:07.650989 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-41e73889-9e04-4d44-9c4c-eb05ca0952f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:07.653551 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-41e73889-9e04-4d44-9c4c-eb05ca0952f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:07.655219 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-41e73889-9e04-4d44-9c4c-eb05ca0952f9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.234620 Nov 02 16:51:07.656119 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 361/746] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:07 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:08.085450 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-42ee2185-7f43-485f-af60-89a653f5fc73 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:08.086361 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-42ee2185-7f43-485f-af60-89a653f5fc73 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:08.099786 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-42ee2185-7f43-485f-af60-89a653f5fc73 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:08.100379 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-42ee2185-7f43-485f-af60-89a653f5fc73 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:08.101855 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-42ee2185-7f43-485f-af60-89a653f5fc73 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:08.102646 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-42ee2185-7f43-485f-af60-89a653f5fc73 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:08.315871 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-42ee2185-7f43-485f-af60-89a653f5fc73 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:08.331734 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-42ee2185-7f43-485f-af60-89a653f5fc73 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.254419 Nov 02 16:51:08.332442 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 386/747] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:08 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:08.677396 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-bbf4a981-0328-468e-9ee7-4f5c36823688 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:08.678781 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-bbf4a981-0328-468e-9ee7-4f5c36823688 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:08.687371 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bbf4a981-0328-468e-9ee7-4f5c36823688 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:08.687856 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bbf4a981-0328-468e-9ee7-4f5c36823688 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:08.688740 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bbf4a981-0328-468e-9ee7-4f5c36823688 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:08.689195 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bbf4a981-0328-468e-9ee7-4f5c36823688 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:08.857864 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-bbf4a981-0328-468e-9ee7-4f5c36823688 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:08.875923 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-bbf4a981-0328-468e-9ee7-4f5c36823688 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:08.879055 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-bbf4a981-0328-468e-9ee7-4f5c36823688 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:08.881211 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-bbf4a981-0328-468e-9ee7-4f5c36823688 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.209270 Nov 02 16:51:08.882299 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 362/748] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:08 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:09.350617 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-61bd5f36-176c-494c-8722-dbcc56b6aca7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:09.351433 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-61bd5f36-176c-494c-8722-dbcc56b6aca7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:09.359642 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-61bd5f36-176c-494c-8722-dbcc56b6aca7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:09.360288 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-61bd5f36-176c-494c-8722-dbcc56b6aca7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:09.361230 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-61bd5f36-176c-494c-8722-dbcc56b6aca7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:09.361798 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-61bd5f36-176c-494c-8722-dbcc56b6aca7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:09.547761 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-61bd5f36-176c-494c-8722-dbcc56b6aca7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:09.556884 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-61bd5f36-176c-494c-8722-dbcc56b6aca7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.210394 Nov 02 16:51:09.557701 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 387/749] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:09 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:09.902585 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-02fd9923-5bbc-43b0-9e3f-0bb475168b47 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:09.903361 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-02fd9923-5bbc-43b0-9e3f-0bb475168b47 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:09.911055 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02fd9923-5bbc-43b0-9e3f-0bb475168b47 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:09.911517 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02fd9923-5bbc-43b0-9e3f-0bb475168b47 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:09.912388 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02fd9923-5bbc-43b0-9e3f-0bb475168b47 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:09.912832 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02fd9923-5bbc-43b0-9e3f-0bb475168b47 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:10.072988 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-02fd9923-5bbc-43b0-9e3f-0bb475168b47 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:10.086381 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-02fd9923-5bbc-43b0-9e3f-0bb475168b47 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:10.089342 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-02fd9923-5bbc-43b0-9e3f-0bb475168b47 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:10.091745 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-02fd9923-5bbc-43b0-9e3f-0bb475168b47 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.193218 Nov 02 16:51:10.092920 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 363/750] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:09 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:10.578319 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-d2410c24-27b7-4890-a811-4d77bab3c5cf tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:10.579041 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d2410c24-27b7-4890-a811-4d77bab3c5cf tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:10.587108 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d2410c24-27b7-4890-a811-4d77bab3c5cf tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:10.587567 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d2410c24-27b7-4890-a811-4d77bab3c5cf tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:10.588429 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d2410c24-27b7-4890-a811-4d77bab3c5cf tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:10.588873 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d2410c24-27b7-4890-a811-4d77bab3c5cf tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:10.763614 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-d2410c24-27b7-4890-a811-4d77bab3c5cf tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:10.773241 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-d2410c24-27b7-4890-a811-4d77bab3c5cf tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.200316 Nov 02 16:51:10.773913 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 388/751] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:10 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:11.112468 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a508c71b-ab26-41b0-8534-f8924d74f8a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:11.113258 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a508c71b-ab26-41b0-8534-f8924d74f8a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:11.125075 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a508c71b-ab26-41b0-8534-f8924d74f8a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:11.126250 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a508c71b-ab26-41b0-8534-f8924d74f8a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:11.126438 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a508c71b-ab26-41b0-8534-f8924d74f8a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:11.126835 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a508c71b-ab26-41b0-8534-f8924d74f8a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:11.313438 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a508c71b-ab26-41b0-8534-f8924d74f8a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:11.326038 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a508c71b-ab26-41b0-8534-f8924d74f8a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:11.327647 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a508c71b-ab26-41b0-8534-f8924d74f8a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:11.328996 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a508c71b-ab26-41b0-8534-f8924d74f8a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.220905 Nov 02 16:51:11.330298 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 364/752] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:11 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:11.794462 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-93c042ee-abf7-462b-9f21-43acbd96811c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:11.795208 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-93c042ee-abf7-462b-9f21-43acbd96811c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:11.802978 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-93c042ee-abf7-462b-9f21-43acbd96811c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:11.803455 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-93c042ee-abf7-462b-9f21-43acbd96811c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:11.804350 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-93c042ee-abf7-462b-9f21-43acbd96811c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:11.804810 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-93c042ee-abf7-462b-9f21-43acbd96811c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:11.977839 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-93c042ee-abf7-462b-9f21-43acbd96811c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:11.987366 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-93c042ee-abf7-462b-9f21-43acbd96811c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.198511 Nov 02 16:51:11.988315 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 389/753] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:11 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:12.348161 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-82b0d7b0-d1b4-40b9-b15d-c9a32eac0c16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:12.348962 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-82b0d7b0-d1b4-40b9-b15d-c9a32eac0c16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:12.357301 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-82b0d7b0-d1b4-40b9-b15d-c9a32eac0c16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:12.357763 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-82b0d7b0-d1b4-40b9-b15d-c9a32eac0c16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:12.358579 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-82b0d7b0-d1b4-40b9-b15d-c9a32eac0c16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:12.359020 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-82b0d7b0-d1b4-40b9-b15d-c9a32eac0c16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:12.514690 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-82b0d7b0-d1b4-40b9-b15d-c9a32eac0c16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:12.524145 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-82b0d7b0-d1b4-40b9-b15d-c9a32eac0c16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:12.525737 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-82b0d7b0-d1b4-40b9-b15d-c9a32eac0c16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:12.526971 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-82b0d7b0-d1b4-40b9-b15d-c9a32eac0c16 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.183087 Nov 02 16:51:12.528156 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 365/754] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:12 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:12.791272 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-128730987", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "networks": [{"uuid": "7227b316-334e-41bd-9e6f-4cc3a5e87f31"}]}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:51:12.849256 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.network.neutron [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] validate_networks() for [('7227b316-334e-41bd-9e6f-4cc3a5e87f31', None, None, None, None, None)] {{(pid=127649) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:51:13.007086 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f2cc8990-8d53-4794-a595-83a5c03221ad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:13.007708 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f2cc8990-8d53-4794-a595-83a5c03221ad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:13.015721 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f2cc8990-8d53-4794-a595-83a5c03221ad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:13.016211 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f2cc8990-8d53-4794-a595-83a5c03221ad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:13.017052 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f2cc8990-8d53-4794-a595-83a5c03221ad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:13.017502 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f2cc8990-8d53-4794-a595-83a5c03221ad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:13.184422 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f2cc8990-8d53-4794-a595-83a5c03221ad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:13.193777 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f2cc8990-8d53-4794-a595-83a5c03221ad tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.190762 Nov 02 16:51:13.194413 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 366/755] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:13 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:13.237351 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Flavor limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:51:13.237807 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Image limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:51:13.238298 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Flavor pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:51:13.238727 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Image pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:51:13.239155 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:51:13.250527 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:13.250978 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:13.251813 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:13.252314 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:13.271181 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Getting quotas for project 4663a8f2673146cab27e2310dd397954. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:51:13.276603 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Getting quotas for user df270eca855a43da84068be7ce6c25e7 and project 4663a8f2673146cab27e2310dd397954. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:51:13.299734 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Going to run 1 instances... {{(pid=127649) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:51:13.299734 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:51:13.347290 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-14cca6f4-0dc5-4264-a687-37f9b9dab2af tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.559968 Nov 02 16:51:13.348074 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 390/756] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:51:12 2021] POST /compute/v2.1/servers => generated 382 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:51:13.362117 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-38414e53-baa0-4747-8c83-8159c318c845 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:13.362899 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-38414e53-baa0-4747-8c83-8159c318c845 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:13.422827 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-38414e53-baa0-4747-8c83-8159c318c845 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:13.432984 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-38414e53-baa0-4747-8c83-8159c318c845 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1217 microversion: 2.1 time: 0.074889 Nov 02 16:51:13.433780 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 367/757] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:13 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:13.547015 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6015bc65-fdea-409e-bfa1-8d0d703a773e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:13.548352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6015bc65-fdea-409e-bfa1-8d0d703a773e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:13.556350 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6015bc65-fdea-409e-bfa1-8d0d703a773e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:13.556913 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6015bc65-fdea-409e-bfa1-8d0d703a773e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:13.558201 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6015bc65-fdea-409e-bfa1-8d0d703a773e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:13.558770 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6015bc65-fdea-409e-bfa1-8d0d703a773e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:13.717629 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6015bc65-fdea-409e-bfa1-8d0d703a773e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:13.728623 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6015bc65-fdea-409e-bfa1-8d0d703a773e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:13.730261 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6015bc65-fdea-409e-bfa1-8d0d703a773e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:13.731555 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6015bc65-fdea-409e-bfa1-8d0d703a773e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.189069 Nov 02 16:51:13.732553 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 391/758] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:13 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:13.890317 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-d6b26eb1-7a23-4333-94f1-be074e06654b req-47e9802f-08b8-43a4-a0bf-cc354a1c0603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df0bde8-504d-42f2-b162-1fb601b26528", "name": "network-vif-plugged", "status": "completed", "tag": "6a36918e-caa7-42ed-b923-c3a049049148"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:51:13.892376 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:51:13.892376 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:51:13.907456 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-d6b26eb1-7a23-4333-94f1-be074e06654b req-47e9802f-08b8-43a4-a0bf-cc354a1c0603 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:13.907922 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-d6b26eb1-7a23-4333-94f1-be074e06654b req-47e9802f-08b8-43a4-a0bf-cc354a1c0603 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:13.921898 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-d6b26eb1-7a23-4333-94f1-be074e06654b req-47e9802f-08b8-43a4-a0bf-cc354a1c0603 service nova] Creating event network-vif-plugged:6a36918e-caa7-42ed-b923-c3a049049148 for instance 3df0bde8-504d-42f2-b162-1fb601b26528 on hv-cinder-77387 Nov 02 16:51:13.930599 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-d6b26eb1-7a23-4333-94f1-be074e06654b req-47e9802f-08b8-43a4-a0bf-cc354a1c0603 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047674 Nov 02 16:51:13.932912 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 368/759] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:51:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:51:13.981118 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-590da92d-9e0c-42f7-a8ea-ecbff24ac992 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:13.981868 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-590da92d-9e0c-42f7-a8ea-ecbff24ac992 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:13.989058 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-590da92d-9e0c-42f7-a8ea-ecbff24ac992 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:13.989526 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-590da92d-9e0c-42f7-a8ea-ecbff24ac992 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:13.990359 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-590da92d-9e0c-42f7-a8ea-ecbff24ac992 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:13.990810 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-590da92d-9e0c-42f7-a8ea-ecbff24ac992 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:14.095007 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-590da92d-9e0c-42f7-a8ea-ecbff24ac992 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lazy-loading 'services' on Instance uuid 1e0809e6-a338-4bc7-8413-86af16333eb4 {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:51:14.178419 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-590da92d-9e0c-42f7-a8ea-ecbff24ac992 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "DELETE /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/os-volume_attachments/78638461-a0b9-4c3b-95a6-af8c5c1d39e4" status: 202 len: 0 microversion: 2.1 time: 0.201633 Nov 02 16:51:14.179948 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 392/760] 10.222.0.118 () {58 vars in 1420 bytes} [Tue Nov 2 16:51:13 2021] DELETE /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/os-volume_attachments/78638461-a0b9-4c3b-95a6-af8c5c1d39e4 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:51:14.216123 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1d580bef-1e60-4f5b-8d8a-3ba334baa2f3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:14.216892 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1d580bef-1e60-4f5b-8d8a-3ba334baa2f3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:14.227043 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1d580bef-1e60-4f5b-8d8a-3ba334baa2f3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:14.227517 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1d580bef-1e60-4f5b-8d8a-3ba334baa2f3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:14.228457 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1d580bef-1e60-4f5b-8d8a-3ba334baa2f3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:14.232555 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1d580bef-1e60-4f5b-8d8a-3ba334baa2f3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:14.433629 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1d580bef-1e60-4f5b-8d8a-3ba334baa2f3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:14.444448 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1d580bef-1e60-4f5b-8d8a-3ba334baa2f3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.235072 Nov 02 16:51:14.451401 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 369/761] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:14 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:14.451977 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-179f6549-abe3-42f9-8b2e-6d5629b22149 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:14.452736 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-179f6549-abe3-42f9-8b2e-6d5629b22149 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:14.459761 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-179f6549-abe3-42f9-8b2e-6d5629b22149 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:14.460440 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-179f6549-abe3-42f9-8b2e-6d5629b22149 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:14.461413 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-179f6549-abe3-42f9-8b2e-6d5629b22149 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:14.461988 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-179f6549-abe3-42f9-8b2e-6d5629b22149 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:14.534394 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-179f6549-abe3-42f9-8b2e-6d5629b22149 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:14.544141 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-179f6549-abe3-42f9-8b2e-6d5629b22149 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1269 microversion: 2.1 time: 0.096842 Nov 02 16:51:14.544830 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 393/762] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:14 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1269 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:51:14.751480 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6d668ba7-c491-423d-adaf-0608ec3b2c6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:14.752343 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6d668ba7-c491-423d-adaf-0608ec3b2c6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:14.759441 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6d668ba7-c491-423d-adaf-0608ec3b2c6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:14.759914 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6d668ba7-c491-423d-adaf-0608ec3b2c6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:14.761050 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6d668ba7-c491-423d-adaf-0608ec3b2c6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:14.761549 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6d668ba7-c491-423d-adaf-0608ec3b2c6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:14.914932 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6d668ba7-c491-423d-adaf-0608ec3b2c6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:14.924846 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6d668ba7-c491-423d-adaf-0608ec3b2c6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:14.926543 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6d668ba7-c491-423d-adaf-0608ec3b2c6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:14.927958 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6d668ba7-c491-423d-adaf-0608ec3b2c6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.180815 Nov 02 16:51:14.928622 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 370/763] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:14 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:15.464942 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0d8e287e-bb56-4450-ac5b-3f5ef1f0a2ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:15.465931 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0d8e287e-bb56-4450-ac5b-3f5ef1f0a2ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:15.473871 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0d8e287e-bb56-4450-ac5b-3f5ef1f0a2ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:15.474402 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0d8e287e-bb56-4450-ac5b-3f5ef1f0a2ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:15.475226 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0d8e287e-bb56-4450-ac5b-3f5ef1f0a2ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:15.477040 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0d8e287e-bb56-4450-ac5b-3f5ef1f0a2ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:15.564860 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4d075de4-2f6b-4d6b-aa71-c29bdeedf3fd tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:15.565645 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4d075de4-2f6b-4d6b-aa71-c29bdeedf3fd tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:15.574778 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d075de4-2f6b-4d6b-aa71-c29bdeedf3fd tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:15.575245 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d075de4-2f6b-4d6b-aa71-c29bdeedf3fd tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:15.576089 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d075de4-2f6b-4d6b-aa71-c29bdeedf3fd tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:15.576589 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d075de4-2f6b-4d6b-aa71-c29bdeedf3fd tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:15.669042 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0d8e287e-bb56-4450-ac5b-3f5ef1f0a2ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:15.669487 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4d075de4-2f6b-4d6b-aa71-c29bdeedf3fd tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:15.678186 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0d8e287e-bb56-4450-ac5b-3f5ef1f0a2ae tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.218051 Nov 02 16:51:15.678836 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 394/764] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:15 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:15.678982 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4d075de4-2f6b-4d6b-aa71-c29bdeedf3fd tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1275 microversion: 2.1 time: 0.120127 Nov 02 16:51:15.685160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 371/765] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:15 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:15.947256 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-738a7758-8701-4096-8143-181195c1a16d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:15.948079 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-738a7758-8701-4096-8143-181195c1a16d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:15.955155 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-738a7758-8701-4096-8143-181195c1a16d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:15.955621 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-738a7758-8701-4096-8143-181195c1a16d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:15.956477 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-738a7758-8701-4096-8143-181195c1a16d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:15.956938 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-738a7758-8701-4096-8143-181195c1a16d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:16.116536 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-738a7758-8701-4096-8143-181195c1a16d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:16.131431 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-738a7758-8701-4096-8143-181195c1a16d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:16.133095 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-738a7758-8701-4096-8143-181195c1a16d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:16.134359 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-738a7758-8701-4096-8143-181195c1a16d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.191361 Nov 02 16:51:16.135028 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 395/766] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:15 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:16.356885 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-02b9c7c0-a3f2-41ce-b509-9ca7e5d65fa6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:51:16.363807 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02b9c7c0-a3f2-41ce-b509-9ca7e5d65fa6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:16.364339 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02b9c7c0-a3f2-41ce-b509-9ca7e5d65fa6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:16.432619 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-02b9c7c0-a3f2-41ce-b509-9ca7e5d65fa6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Going to try to stop instance {{(pid=127648) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Nov 02 16:51:16.518079 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-02b9c7c0-a3f2-41ce-b509-9ca7e5d65fa6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 202 len: 0 microversion: 2.1 time: 0.166355 Nov 02 16:51:16.519506 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 372/767] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:51:16 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:51:16.527970 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b3009642-bbd2-4b7d-ad01-af485d683119 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:16.529691 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b3009642-bbd2-4b7d-ad01-af485d683119 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:16.538086 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b3009642-bbd2-4b7d-ad01-af485d683119 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:16.543755 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b3009642-bbd2-4b7d-ad01-af485d683119 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:16.543755 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b3009642-bbd2-4b7d-ad01-af485d683119 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:16.543755 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b3009642-bbd2-4b7d-ad01-af485d683119 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:16.611885 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-f67a1a1c-933f-4580-9c9c-1d5928cedd50 req-8f59d445-a001-412c-a097-3d284a3a7fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3b482c-b905-4e66-a4a0-d271e1b9609c", "tag": "2059d2b9-f963-4403-ba82-a619b510a65a"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:51:16.613871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:51:16.613871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:51:16.627706 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-f67a1a1c-933f-4580-9c9c-1d5928cedd50 req-8f59d445-a001-412c-a097-3d284a3a7fdd service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:16.628167 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-f67a1a1c-933f-4580-9c9c-1d5928cedd50 req-8f59d445-a001-412c-a097-3d284a3a7fdd service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:16.643034 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-f67a1a1c-933f-4580-9c9c-1d5928cedd50 req-8f59d445-a001-412c-a097-3d284a3a7fdd service nova] Creating event network-changed:2059d2b9-f963-4403-ba82-a619b510a65a for instance 6f3b482c-b905-4e66-a4a0-d271e1b9609c on hv-cinder-77387 Nov 02 16:51:16.664018 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-f67a1a1c-933f-4580-9c9c-1d5928cedd50 req-8f59d445-a001-412c-a097-3d284a3a7fdd service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061558 Nov 02 16:51:16.665198 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 373/768] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:51:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:51:16.699450 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1da68fee-5d68-4f73-a57b-84633081ef36 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:16.700213 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1da68fee-5d68-4f73-a57b-84633081ef36 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:16.709840 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1da68fee-5d68-4f73-a57b-84633081ef36 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:16.710622 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1da68fee-5d68-4f73-a57b-84633081ef36 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:16.711635 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1da68fee-5d68-4f73-a57b-84633081ef36 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:16.712284 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1da68fee-5d68-4f73-a57b-84633081ef36 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:16.754895 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b3009642-bbd2-4b7d-ad01-af485d683119 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:16.768791 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b3009642-bbd2-4b7d-ad01-af485d683119 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.244879 Nov 02 16:51:16.769463 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 396/769] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:16 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:16.775021 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-97f4bdb9-eb42-4c4c-bf38-0a4c30a49db2 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:16.775893 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-97f4bdb9-eb42-4c4c-bf38-0a4c30a49db2 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:16.793647 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-97f4bdb9-eb42-4c4c-bf38-0a4c30a49db2 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:16.794137 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-97f4bdb9-eb42-4c4c-bf38-0a4c30a49db2 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:16.794984 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-97f4bdb9-eb42-4c4c-bf38-0a4c30a49db2 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:16.795428 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-97f4bdb9-eb42-4c4c-bf38-0a4c30a49db2 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:16.978434 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-97f4bdb9-eb42-4c4c-bf38-0a4c30a49db2 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:17.006312 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-97f4bdb9-eb42-4c4c-bf38-0a4c30a49db2 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1317 microversion: 2.1 time: 0.234914 Nov 02 16:51:17.012951 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 397/770] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:16 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:17.052064 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1da68fee-5d68-4f73-a57b-84633081ef36 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:17.066833 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1da68fee-5d68-4f73-a57b-84633081ef36 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.372817 Nov 02 16:51:17.079939 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 374/771] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:16 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:17.156381 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-78cfa3ff-4886-4aae-ab85-7dba36cf1f7f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:17.157074 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-78cfa3ff-4886-4aae-ab85-7dba36cf1f7f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:17.164220 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78cfa3ff-4886-4aae-ab85-7dba36cf1f7f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:17.164677 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78cfa3ff-4886-4aae-ab85-7dba36cf1f7f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:17.165507 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78cfa3ff-4886-4aae-ab85-7dba36cf1f7f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:17.165954 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-78cfa3ff-4886-4aae-ab85-7dba36cf1f7f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:17.342074 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-78cfa3ff-4886-4aae-ab85-7dba36cf1f7f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:17.353938 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-78cfa3ff-4886-4aae-ab85-7dba36cf1f7f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:17.356147 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-78cfa3ff-4886-4aae-ab85-7dba36cf1f7f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:17.357482 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-78cfa3ff-4886-4aae-ab85-7dba36cf1f7f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1813 microversion: 2.20 time: 0.206488 Nov 02 16:51:17.358117 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 398/772] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:17 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1813 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:17.787951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-8a04f98f-3fcd-4eb1-b055-82f0ad12fb29 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:17.789197 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8a04f98f-3fcd-4eb1-b055-82f0ad12fb29 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:17.800808 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8a04f98f-3fcd-4eb1-b055-82f0ad12fb29 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:17.801280 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8a04f98f-3fcd-4eb1-b055-82f0ad12fb29 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:17.802176 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8a04f98f-3fcd-4eb1-b055-82f0ad12fb29 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:17.802928 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8a04f98f-3fcd-4eb1-b055-82f0ad12fb29 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:18.035678 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-39b13a89-7831-473a-942f-10611306ac57 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:18.038945 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-39b13a89-7831-473a-942f-10611306ac57 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:18.053635 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-39b13a89-7831-473a-942f-10611306ac57 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:18.054525 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-39b13a89-7831-473a-942f-10611306ac57 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:18.056107 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-39b13a89-7831-473a-942f-10611306ac57 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:18.057008 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-39b13a89-7831-473a-942f-10611306ac57 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:18.076644 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-8a04f98f-3fcd-4eb1-b055-82f0ad12fb29 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:18.089540 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-8a04f98f-3fcd-4eb1-b055-82f0ad12fb29 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.305777 Nov 02 16:51:18.090195 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 375/773] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:17 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:18.096401 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3fd75342-78f3-4ff3-ba8b-c6fed78fe9de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:18.097030 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3fd75342-78f3-4ff3-ba8b-c6fed78fe9de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:18.105596 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3fd75342-78f3-4ff3-ba8b-c6fed78fe9de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:18.105935 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3fd75342-78f3-4ff3-ba8b-c6fed78fe9de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:18.106896 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3fd75342-78f3-4ff3-ba8b-c6fed78fe9de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:18.107349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3fd75342-78f3-4ff3-ba8b-c6fed78fe9de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:18.282632 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-39b13a89-7831-473a-942f-10611306ac57 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:18.296565 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-39b13a89-7831-473a-942f-10611306ac57 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1317 microversion: 2.1 time: 0.269130 Nov 02 16:51:18.297190 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 399/774] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:18 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:51:18.346511 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3fd75342-78f3-4ff3-ba8b-c6fed78fe9de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:18.357466 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3fd75342-78f3-4ff3-ba8b-c6fed78fe9de tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.265371 Nov 02 16:51:18.358245 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 376/775] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:18 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:18.377200 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1034cfd2-5134-42ed-89a6-fd2eaabc211a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:18.377827 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1034cfd2-5134-42ed-89a6-fd2eaabc211a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:18.387242 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1034cfd2-5134-42ed-89a6-fd2eaabc211a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:18.387709 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1034cfd2-5134-42ed-89a6-fd2eaabc211a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:18.388608 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1034cfd2-5134-42ed-89a6-fd2eaabc211a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:18.389047 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1034cfd2-5134-42ed-89a6-fd2eaabc211a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:18.551734 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1034cfd2-5134-42ed-89a6-fd2eaabc211a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:18.562511 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1034cfd2-5134-42ed-89a6-fd2eaabc211a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:18.564075 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1034cfd2-5134-42ed-89a6-fd2eaabc211a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:18.565376 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1034cfd2-5134-42ed-89a6-fd2eaabc211a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1800 microversion: 2.20 time: 0.192689 Nov 02 16:51:18.565998 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 400/776] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:51:18 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1800 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:51:19.115191 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-911ed565-1c3e-4455-8120-5d64c35892b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:19.115936 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-911ed565-1c3e-4455-8120-5d64c35892b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:19.123505 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-911ed565-1c3e-4455-8120-5d64c35892b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:19.123980 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-911ed565-1c3e-4455-8120-5d64c35892b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:19.124877 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-911ed565-1c3e-4455-8120-5d64c35892b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:19.125340 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-911ed565-1c3e-4455-8120-5d64c35892b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:19.285421 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-911ed565-1c3e-4455-8120-5d64c35892b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:19.294540 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-911ed565-1c3e-4455-8120-5d64c35892b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.183428 Nov 02 16:51:19.295200 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 377/777] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:19 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:19.315240 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3a34f9b1-1182-4d63-af59-261dc200cab9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:19.315901 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3a34f9b1-1182-4d63-af59-261dc200cab9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:19.323183 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3a34f9b1-1182-4d63-af59-261dc200cab9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:19.324529 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3a34f9b1-1182-4d63-af59-261dc200cab9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:19.325393 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3a34f9b1-1182-4d63-af59-261dc200cab9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:19.325835 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3a34f9b1-1182-4d63-af59-261dc200cab9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:19.376431 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-67ade2ee-edcc-43e6-b29d-1dad6be02266 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:19.377100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-67ade2ee-edcc-43e6-b29d-1dad6be02266 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:19.383584 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67ade2ee-edcc-43e6-b29d-1dad6be02266 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:19.384723 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67ade2ee-edcc-43e6-b29d-1dad6be02266 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:19.385953 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67ade2ee-edcc-43e6-b29d-1dad6be02266 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:19.386415 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-67ade2ee-edcc-43e6-b29d-1dad6be02266 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:19.477910 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3a34f9b1-1182-4d63-af59-261dc200cab9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:19.488703 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3a34f9b1-1182-4d63-af59-261dc200cab9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1317 microversion: 2.1 time: 0.177598 Nov 02 16:51:19.489515 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 401/778] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:19 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:19.581100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-67ade2ee-edcc-43e6-b29d-1dad6be02266 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:19.590925 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-67ade2ee-edcc-43e6-b29d-1dad6be02266 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.218579 Nov 02 16:51:19.591597 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 378/779] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:19 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:20.313416 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7783b50e-c908-47af-8a60-11eae8048878 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:20.314060 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7783b50e-c908-47af-8a60-11eae8048878 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:20.322205 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7783b50e-c908-47af-8a60-11eae8048878 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:20.323054 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7783b50e-c908-47af-8a60-11eae8048878 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:20.323497 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7783b50e-c908-47af-8a60-11eae8048878 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:20.324603 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7783b50e-c908-47af-8a60-11eae8048878 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:20.476642 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7783b50e-c908-47af-8a60-11eae8048878 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:20.485785 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7783b50e-c908-47af-8a60-11eae8048878 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.177113 Nov 02 16:51:20.486489 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 402/780] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:20 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:20.513437 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-92777c9e-df51-4bae-9866-caf001d38f6c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:20.514387 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-92777c9e-df51-4bae-9866-caf001d38f6c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:20.525049 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-92777c9e-df51-4bae-9866-caf001d38f6c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:20.525507 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-92777c9e-df51-4bae-9866-caf001d38f6c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:20.527434 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-92777c9e-df51-4bae-9866-caf001d38f6c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:20.528055 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-92777c9e-df51-4bae-9866-caf001d38f6c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:20.619946 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-665e14f0-f6c4-4ce1-ae31-6baae188d800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:20.621534 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-665e14f0-f6c4-4ce1-ae31-6baae188d800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:20.629590 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-665e14f0-f6c4-4ce1-ae31-6baae188d800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:20.630081 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-665e14f0-f6c4-4ce1-ae31-6baae188d800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:20.630934 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-665e14f0-f6c4-4ce1-ae31-6baae188d800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:20.631383 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-665e14f0-f6c4-4ce1-ae31-6baae188d800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:20.746594 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-92777c9e-df51-4bae-9866-caf001d38f6c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:20.756551 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-92777c9e-df51-4bae-9866-caf001d38f6c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1317 microversion: 2.1 time: 0.252717 Nov 02 16:51:20.757644 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 379/781] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:20 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:20.877169 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-665e14f0-f6c4-4ce1-ae31-6baae188d800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:20.887303 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-665e14f0-f6c4-4ce1-ae31-6baae188d800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.274443 Nov 02 16:51:20.887966 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 403/782] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:20 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:21.511955 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3d560734-8dfa-44dd-93ef-ef820f327a15 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:21.512809 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3d560734-8dfa-44dd-93ef-ef820f327a15 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:21.520639 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3d560734-8dfa-44dd-93ef-ef820f327a15 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:21.521456 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3d560734-8dfa-44dd-93ef-ef820f327a15 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:21.521946 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3d560734-8dfa-44dd-93ef-ef820f327a15 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:21.522401 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3d560734-8dfa-44dd-93ef-ef820f327a15 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:21.674495 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3d560734-8dfa-44dd-93ef-ef820f327a15 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:21.683901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3d560734-8dfa-44dd-93ef-ef820f327a15 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.177432 Nov 02 16:51:21.684685 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 380/783] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:21 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:21.778912 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5c80caf2-bdd7-4523-a9c9-cabf8f9bc194 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:21.781042 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5c80caf2-bdd7-4523-a9c9-cabf8f9bc194 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:21.789272 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5c80caf2-bdd7-4523-a9c9-cabf8f9bc194 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:21.789817 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5c80caf2-bdd7-4523-a9c9-cabf8f9bc194 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:21.790701 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5c80caf2-bdd7-4523-a9c9-cabf8f9bc194 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:21.791223 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5c80caf2-bdd7-4523-a9c9-cabf8f9bc194 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:21.906701 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3868d7b3-cfd5-471e-87b9-93da39e229c3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:21.908167 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3868d7b3-cfd5-471e-87b9-93da39e229c3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:21.916924 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3868d7b3-cfd5-471e-87b9-93da39e229c3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:21.918280 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3868d7b3-cfd5-471e-87b9-93da39e229c3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:21.919550 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3868d7b3-cfd5-471e-87b9-93da39e229c3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:21.920123 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3868d7b3-cfd5-471e-87b9-93da39e229c3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:21.969053 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5c80caf2-bdd7-4523-a9c9-cabf8f9bc194 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:21.988590 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5c80caf2-bdd7-4523-a9c9-cabf8f9bc194 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1317 microversion: 2.1 time: 0.213861 Nov 02 16:51:21.989249 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 404/784] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:21 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:22.106636 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3868d7b3-cfd5-471e-87b9-93da39e229c3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:22.116370 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3868d7b3-cfd5-471e-87b9-93da39e229c3 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.214518 Nov 02 16:51:22.117040 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 381/785] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:21 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:22.702861 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-265d72b4-78e7-49e2-9e81-1796122e16c7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:22.703386 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-265d72b4-78e7-49e2-9e81-1796122e16c7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:22.711055 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-265d72b4-78e7-49e2-9e81-1796122e16c7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:22.711510 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-265d72b4-78e7-49e2-9e81-1796122e16c7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:22.712717 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-265d72b4-78e7-49e2-9e81-1796122e16c7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:22.714099 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-265d72b4-78e7-49e2-9e81-1796122e16c7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:22.875906 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-265d72b4-78e7-49e2-9e81-1796122e16c7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:22.884741 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-265d72b4-78e7-49e2-9e81-1796122e16c7 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.186771 Nov 02 16:51:22.885391 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 405/786] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:22 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:23.009569 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-53775edc-fa03-4ba6-b0fd-d89692f2e117 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:23.010190 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-53775edc-fa03-4ba6-b0fd-d89692f2e117 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:23.018295 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-53775edc-fa03-4ba6-b0fd-d89692f2e117 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:23.018764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-53775edc-fa03-4ba6-b0fd-d89692f2e117 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:23.019620 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-53775edc-fa03-4ba6-b0fd-d89692f2e117 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:23.020107 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-53775edc-fa03-4ba6-b0fd-d89692f2e117 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:23.139584 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0bb6e217-8583-4a33-8344-4830d51f9c80 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:23.140354 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0bb6e217-8583-4a33-8344-4830d51f9c80 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:23.147940 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0bb6e217-8583-4a33-8344-4830d51f9c80 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:23.148456 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0bb6e217-8583-4a33-8344-4830d51f9c80 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:23.149329 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0bb6e217-8583-4a33-8344-4830d51f9c80 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:23.149775 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0bb6e217-8583-4a33-8344-4830d51f9c80 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:23.193337 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-53775edc-fa03-4ba6-b0fd-d89692f2e117 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:23.207769 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-53775edc-fa03-4ba6-b0fd-d89692f2e117 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1317 microversion: 2.1 time: 0.202681 Nov 02 16:51:23.208884 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 382/787] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:23 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:23.376855 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0bb6e217-8583-4a33-8344-4830d51f9c80 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:23.386156 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0bb6e217-8583-4a33-8344-4830d51f9c80 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.251889 Nov 02 16:51:23.386809 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 406/788] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:23 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:23.907623 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-8ff3516b-22b1-4e56-b8e9-f2260d4a3a78 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:23.908314 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8ff3516b-22b1-4e56-b8e9-f2260d4a3a78 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:23.916493 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8ff3516b-22b1-4e56-b8e9-f2260d4a3a78 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:23.917474 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8ff3516b-22b1-4e56-b8e9-f2260d4a3a78 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:23.918856 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8ff3516b-22b1-4e56-b8e9-f2260d4a3a78 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:23.919596 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8ff3516b-22b1-4e56-b8e9-f2260d4a3a78 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:23.963042 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-2cf42ef1-b109-48e1-ae95-fe47949c4f07 req-d0663c5c-c966-42f5-9050-09493af6ae42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3b482c-b905-4e66-a4a0-d271e1b9609c", "name": "network-vif-plugged", "status": "completed", "tag": "2059d2b9-f963-4403-ba82-a619b510a65a"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:51:23.970225 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:51:23.970225 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:51:23.985882 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-2cf42ef1-b109-48e1-ae95-fe47949c4f07 req-d0663c5c-c966-42f5-9050-09493af6ae42 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:23.986396 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-2cf42ef1-b109-48e1-ae95-fe47949c4f07 req-d0663c5c-c966-42f5-9050-09493af6ae42 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:24.006864 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-2cf42ef1-b109-48e1-ae95-fe47949c4f07 req-d0663c5c-c966-42f5-9050-09493af6ae42 service nova] Creating event network-vif-plugged:2059d2b9-f963-4403-ba82-a619b510a65a for instance 6f3b482c-b905-4e66-a4a0-d271e1b9609c on hv-cinder-77387 Nov 02 16:51:24.015707 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-2cf42ef1-b109-48e1-ae95-fe47949c4f07 req-d0663c5c-c966-42f5-9050-09493af6ae42 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066468 Nov 02 16:51:24.016586 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 407/789] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:51:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:51:24.112815 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-8ff3516b-22b1-4e56-b8e9-f2260d4a3a78 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:24.124892 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-8ff3516b-22b1-4e56-b8e9-f2260d4a3a78 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.223425 Nov 02 16:51:24.125573 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 383/790] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:23 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:51:24.228953 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0f9334ef-7e03-4ee7-bf41-b3b7683ff23d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:24.229508 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0f9334ef-7e03-4ee7-bf41-b3b7683ff23d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:24.238914 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0f9334ef-7e03-4ee7-bf41-b3b7683ff23d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:24.239597 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0f9334ef-7e03-4ee7-bf41-b3b7683ff23d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:24.240873 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0f9334ef-7e03-4ee7-bf41-b3b7683ff23d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:24.242262 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0f9334ef-7e03-4ee7-bf41-b3b7683ff23d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:24.406014 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5fe5a079-da81-4308-bf23-791bfd81d7a5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:24.406658 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5fe5a079-da81-4308-bf23-791bfd81d7a5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:24.413267 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5fe5a079-da81-4308-bf23-791bfd81d7a5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:24.413743 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5fe5a079-da81-4308-bf23-791bfd81d7a5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:24.414605 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5fe5a079-da81-4308-bf23-791bfd81d7a5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:24.415056 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5fe5a079-da81-4308-bf23-791bfd81d7a5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:24.551572 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0f9334ef-7e03-4ee7-bf41-b3b7683ff23d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:24.560970 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0f9334ef-7e03-4ee7-bf41-b3b7683ff23d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1317 microversion: 2.1 time: 0.336816 Nov 02 16:51:24.561641 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 408/791] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:24 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:24.593086 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5fe5a079-da81-4308-bf23-791bfd81d7a5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:24.603120 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5fe5a079-da81-4308-bf23-791bfd81d7a5 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.201272 Nov 02 16:51:24.603771 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 384/792] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:24 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:51:25.144211 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-299d56cd-3511-4f24-84c9-9cfeba84af3d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:25.144964 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-299d56cd-3511-4f24-84c9-9cfeba84af3d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:25.153621 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-299d56cd-3511-4f24-84c9-9cfeba84af3d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:25.154065 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-299d56cd-3511-4f24-84c9-9cfeba84af3d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:25.154921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-299d56cd-3511-4f24-84c9-9cfeba84af3d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:25.155376 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-299d56cd-3511-4f24-84c9-9cfeba84af3d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:25.321580 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-299d56cd-3511-4f24-84c9-9cfeba84af3d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:25.331085 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-299d56cd-3511-4f24-84c9-9cfeba84af3d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.191084 Nov 02 16:51:25.331741 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 409/793] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:25 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:25.578988 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-dd8cac52-2e0c-4333-a746-c3336f250198 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:25.579799 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-dd8cac52-2e0c-4333-a746-c3336f250198 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:25.586784 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dd8cac52-2e0c-4333-a746-c3336f250198 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:25.587242 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dd8cac52-2e0c-4333-a746-c3336f250198 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:25.588047 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dd8cac52-2e0c-4333-a746-c3336f250198 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:25.588528 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dd8cac52-2e0c-4333-a746-c3336f250198 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:25.623009 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-79ad69bc-9534-4f1c-ad73-024a37d6c203 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:25.623772 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-79ad69bc-9534-4f1c-ad73-024a37d6c203 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:25.631167 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-79ad69bc-9534-4f1c-ad73-024a37d6c203 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:25.631602 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-79ad69bc-9534-4f1c-ad73-024a37d6c203 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:25.632464 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-79ad69bc-9534-4f1c-ad73-024a37d6c203 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:25.632910 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-79ad69bc-9534-4f1c-ad73-024a37d6c203 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:25.810149 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-79ad69bc-9534-4f1c-ad73-024a37d6c203 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:25.815892 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-dd8cac52-2e0c-4333-a746-c3336f250198 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:25.819429 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-79ad69bc-9534-4f1c-ad73-024a37d6c203 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1758 microversion: 2.1 time: 0.201353 Nov 02 16:51:25.820090 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 410/794] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:25 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:25.824447 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-dd8cac52-2e0c-4333-a746-c3336f250198 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1317 microversion: 2.1 time: 0.249633 Nov 02 16:51:25.825090 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 385/795] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:25 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:26.350212 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fa214ee2-50d4-4f27-8fff-75a3871ee8de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:26.350921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fa214ee2-50d4-4f27-8fff-75a3871ee8de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:26.359995 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fa214ee2-50d4-4f27-8fff-75a3871ee8de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:26.360542 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fa214ee2-50d4-4f27-8fff-75a3871ee8de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:26.361358 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fa214ee2-50d4-4f27-8fff-75a3871ee8de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:26.361809 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fa214ee2-50d4-4f27-8fff-75a3871ee8de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:26.518840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-fa214ee2-50d4-4f27-8fff-75a3871ee8de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:26.530674 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fa214ee2-50d4-4f27-8fff-75a3871ee8de tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.184608 Nov 02 16:51:26.531355 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 411/796] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:26 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:26.838298 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cef5fbb4-c565-494b-9719-4331c0bad1a7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:26.839186 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-cef5fbb4-c565-494b-9719-4331c0bad1a7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:26.842533 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8d747e67-2d2b-44a9-b5de-84eac4c8b028 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:26.843179 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8d747e67-2d2b-44a9-b5de-84eac4c8b028 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:26.847258 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cef5fbb4-c565-494b-9719-4331c0bad1a7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:26.847813 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cef5fbb4-c565-494b-9719-4331c0bad1a7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:26.848828 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cef5fbb4-c565-494b-9719-4331c0bad1a7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:26.849129 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cef5fbb4-c565-494b-9719-4331c0bad1a7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:26.849818 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8d747e67-2d2b-44a9-b5de-84eac4c8b028 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:26.850309 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8d747e67-2d2b-44a9-b5de-84eac4c8b028 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:26.851115 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8d747e67-2d2b-44a9-b5de-84eac4c8b028 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:26.851560 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8d747e67-2d2b-44a9-b5de-84eac4c8b028 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:27.017455 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8d747e67-2d2b-44a9-b5de-84eac4c8b028 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:27.027229 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8d747e67-2d2b-44a9-b5de-84eac4c8b028 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1501 microversion: 2.1 time: 0.188966 Nov 02 16:51:27.028258 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 412/797] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:26 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1501 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:51:27.074184 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-cef5fbb4-c565-494b-9719-4331c0bad1a7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:27.095958 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-cef5fbb4-c565-494b-9719-4331c0bad1a7 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1761 microversion: 2.1 time: 0.260260 Nov 02 16:51:27.097140 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 386/798] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:26 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1761 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:27.552969 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b782149e-d3c2-4aa1-8f0e-0a40306168ae tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:27.553902 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b782149e-d3c2-4aa1-8f0e-0a40306168ae tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:27.562149 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b782149e-d3c2-4aa1-8f0e-0a40306168ae tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:27.562625 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b782149e-d3c2-4aa1-8f0e-0a40306168ae tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:27.563484 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b782149e-d3c2-4aa1-8f0e-0a40306168ae tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:27.564028 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b782149e-d3c2-4aa1-8f0e-0a40306168ae tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:27.701562 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-beb424c2-6537-427b-99c5-5ec0e2116e5a tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:27.702103 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-beb424c2-6537-427b-99c5-5ec0e2116e5a tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:27.709268 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-beb424c2-6537-427b-99c5-5ec0e2116e5a tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:27.709736 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-beb424c2-6537-427b-99c5-5ec0e2116e5a tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:27.710577 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-beb424c2-6537-427b-99c5-5ec0e2116e5a tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:27.711035 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-beb424c2-6537-427b-99c5-5ec0e2116e5a tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:27.738371 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b782149e-d3c2-4aa1-8f0e-0a40306168ae tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:27.740957 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-beb424c2-6537-427b-99c5-5ec0e2116e5a tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Going to try to terminate instance {{(pid=127648) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:51:27.749209 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b782149e-d3c2-4aa1-8f0e-0a40306168ae tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.202343 Nov 02 16:51:27.750211 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 413/799] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:27 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:27.834768 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-beb424c2-6537-427b-99c5-5ec0e2116e5a tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "DELETE /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 204 len: 0 microversion: 2.1 time: 0.137986 Nov 02 16:51:27.835599 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 387/800] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:51:27 2021] DELETE /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 16:51:27.845653 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-cf47cad4-c850-446b-919a-491a5107e95d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:27.846307 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-cf47cad4-c850-446b-919a-491a5107e95d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:27.853430 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cf47cad4-c850-446b-919a-491a5107e95d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:27.853899 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cf47cad4-c850-446b-919a-491a5107e95d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:27.856223 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cf47cad4-c850-446b-919a-491a5107e95d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:27.856687 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cf47cad4-c850-446b-919a-491a5107e95d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:28.019215 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-cf47cad4-c850-446b-919a-491a5107e95d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:28.028990 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-cf47cad4-c850-446b-919a-491a5107e95d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1507 microversion: 2.1 time: 0.187813 Nov 02 16:51:28.029654 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 414/801] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:27 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:28.769938 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6c5b573a-4150-4368-9c02-b4aa9ff68ccd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:28.770736 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6c5b573a-4150-4368-9c02-b4aa9ff68ccd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:28.780364 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6c5b573a-4150-4368-9c02-b4aa9ff68ccd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:28.780912 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6c5b573a-4150-4368-9c02-b4aa9ff68ccd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:28.781890 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6c5b573a-4150-4368-9c02-b4aa9ff68ccd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:28.782367 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6c5b573a-4150-4368-9c02-b4aa9ff68ccd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:28.977411 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6c5b573a-4150-4368-9c02-b4aa9ff68ccd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:28.987858 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6c5b573a-4150-4368-9c02-b4aa9ff68ccd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.222743 Nov 02 16:51:28.988583 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 388/802] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:28 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:29.048802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7c4f2fb9-1791-4fec-836c-3e4aa2c6c2a1 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:29.049538 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7c4f2fb9-1791-4fec-836c-3e4aa2c6c2a1 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:29.056969 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7c4f2fb9-1791-4fec-836c-3e4aa2c6c2a1 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:29.057427 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7c4f2fb9-1791-4fec-836c-3e4aa2c6c2a1 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:29.058288 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7c4f2fb9-1791-4fec-836c-3e4aa2c6c2a1 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:29.058723 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7c4f2fb9-1791-4fec-836c-3e4aa2c6c2a1 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:29.214397 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7c4f2fb9-1791-4fec-836c-3e4aa2c6c2a1 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:29.222479 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7c4f2fb9-1791-4fec-836c-3e4aa2c6c2a1 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1507 microversion: 2.1 time: 0.178107 Nov 02 16:51:29.223145 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 415/803] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:29 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:30.007862 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2f985e83-927a-4c9f-946c-fc753e2c10eb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:30.008953 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2f985e83-927a-4c9f-946c-fc753e2c10eb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:30.017191 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2f985e83-927a-4c9f-946c-fc753e2c10eb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:30.017664 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2f985e83-927a-4c9f-946c-fc753e2c10eb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:30.018539 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2f985e83-927a-4c9f-946c-fc753e2c10eb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:30.018997 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2f985e83-927a-4c9f-946c-fc753e2c10eb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:30.244923 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-99d59c4f-0452-4531-9b2a-5fcb5c7b9cb9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:30.246498 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-99d59c4f-0452-4531-9b2a-5fcb5c7b9cb9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:30.254196 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-99d59c4f-0452-4531-9b2a-5fcb5c7b9cb9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:30.254671 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-99d59c4f-0452-4531-9b2a-5fcb5c7b9cb9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:30.255576 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-99d59c4f-0452-4531-9b2a-5fcb5c7b9cb9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:30.256026 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-99d59c4f-0452-4531-9b2a-5fcb5c7b9cb9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:30.268016 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2f985e83-927a-4c9f-946c-fc753e2c10eb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:30.279066 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2f985e83-927a-4c9f-946c-fc753e2c10eb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.275372 Nov 02 16:51:30.280202 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 389/804] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:30 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:30.413365 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-99d59c4f-0452-4531-9b2a-5fcb5c7b9cb9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:30.422192 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-99d59c4f-0452-4531-9b2a-5fcb5c7b9cb9 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1507 microversion: 2.1 time: 0.183980 Nov 02 16:51:30.423011 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 416/805] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:30 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:30.537657 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-1f613add-10b3-49af-bcf7-8fd85dfa6e33 req-a6a139fd-2d28-43ee-98b9-86ef5ea1d79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3b482c-b905-4e66-a4a0-d271e1b9609c", "name": "network-vif-deleted", "tag": "2059d2b9-f963-4403-ba82-a619b510a65a"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:51:30.539399 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:51:30.539399 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:51:30.549062 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-1f613add-10b3-49af-bcf7-8fd85dfa6e33 req-a6a139fd-2d28-43ee-98b9-86ef5ea1d79f service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:30.549530 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-1f613add-10b3-49af-bcf7-8fd85dfa6e33 req-a6a139fd-2d28-43ee-98b9-86ef5ea1d79f service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:30.562267 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-1f613add-10b3-49af-bcf7-8fd85dfa6e33 req-a6a139fd-2d28-43ee-98b9-86ef5ea1d79f service nova] Creating event network-vif-deleted:2059d2b9-f963-4403-ba82-a619b510a65a for instance 6f3b482c-b905-4e66-a4a0-d271e1b9609c on hv-cinder-77387 Nov 02 16:51:30.568011 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-1f613add-10b3-49af-bcf7-8fd85dfa6e33 req-a6a139fd-2d28-43ee-98b9-86ef5ea1d79f service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034287 Nov 02 16:51:30.568812 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 390/806] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:51:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:51:31.299890 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1bb180d3-19bc-44de-8ccb-63add39f1fc0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:31.300730 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1bb180d3-19bc-44de-8ccb-63add39f1fc0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:31.311633 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1bb180d3-19bc-44de-8ccb-63add39f1fc0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:31.312167 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1bb180d3-19bc-44de-8ccb-63add39f1fc0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:31.313350 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1bb180d3-19bc-44de-8ccb-63add39f1fc0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:31.313880 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1bb180d3-19bc-44de-8ccb-63add39f1fc0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:31.442962 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7e477a58-b484-426c-85a2-09f98d070b5c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:31.443803 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7e477a58-b484-426c-85a2-09f98d070b5c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:31.451538 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e477a58-b484-426c-85a2-09f98d070b5c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:31.452008 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e477a58-b484-426c-85a2-09f98d070b5c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:31.452876 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e477a58-b484-426c-85a2-09f98d070b5c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:31.453319 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e477a58-b484-426c-85a2-09f98d070b5c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:31.465315 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1bb180d3-19bc-44de-8ccb-63add39f1fc0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:31.475186 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1bb180d3-19bc-44de-8ccb-63add39f1fc0 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.179528 Nov 02 16:51:31.475833 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 417/807] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:31 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:31.521646 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7e477a58-b484-426c-85a2-09f98d070b5c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:31.530753 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7e477a58-b484-426c-85a2-09f98d070b5c tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1302 microversion: 2.1 time: 0.092295 Nov 02 16:51:31.531381 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 391/808] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:31 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:51:32.493926 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3865b4db-d0e0-4476-83ff-f6aa44381453 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:32.494650 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3865b4db-d0e0-4476-83ff-f6aa44381453 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:32.501978 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3865b4db-d0e0-4476-83ff-f6aa44381453 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:32.502437 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3865b4db-d0e0-4476-83ff-f6aa44381453 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:32.503238 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3865b4db-d0e0-4476-83ff-f6aa44381453 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:32.503680 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3865b4db-d0e0-4476-83ff-f6aa44381453 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:32.548217 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-19eae995-2155-4bd5-9d98-466decb0a550 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:32.549013 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-19eae995-2155-4bd5-9d98-466decb0a550 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:32.555959 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-19eae995-2155-4bd5-9d98-466decb0a550 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:32.556501 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-19eae995-2155-4bd5-9d98-466decb0a550 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:32.557276 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-19eae995-2155-4bd5-9d98-466decb0a550 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:32.557929 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-19eae995-2155-4bd5-9d98-466decb0a550 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:32.624740 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-19eae995-2155-4bd5-9d98-466decb0a550 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:32.632917 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-19eae995-2155-4bd5-9d98-466decb0a550 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 200 len: 1302 microversion: 2.1 time: 0.088829 Nov 02 16:51:32.633569 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 392/809] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:32 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 1302 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:32.651119 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3865b4db-d0e0-4476-83ff-f6aa44381453 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:32.660013 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3865b4db-d0e0-4476-83ff-f6aa44381453 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1681 microversion: 2.1 time: 0.170327 Nov 02 16:51:32.660697 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 418/810] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:32 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:33.651854 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e63f211c-8ef4-4461-93ef-456cc39a4415 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:33.652759 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e63f211c-8ef4-4461-93ef-456cc39a4415 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 6f3b482c-b905-4e66-a4a0-d271e1b9609c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:33.659722 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e63f211c-8ef4-4461-93ef-456cc39a4415 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:33.660300 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e63f211c-8ef4-4461-93ef-456cc39a4415 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:33.661147 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e63f211c-8ef4-4461-93ef-456cc39a4415 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:33.661597 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e63f211c-8ef4-4461-93ef-456cc39a4415 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:33.677520 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-e63f211c-8ef4-4461-93ef-456cc39a4415 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] HTTP exception thrown: Instance 6f3b482c-b905-4e66-a4a0-d271e1b9609c could not be found. Nov 02 16:51:33.678167 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e63f211c-8ef4-4461-93ef-456cc39a4415 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Returning 404 to user: Instance 6f3b482c-b905-4e66-a4a0-d271e1b9609c could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:51:33.679127 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e63f211c-8ef4-4461-93ef-456cc39a4415 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c" status: 404 len: 111 microversion: 2.1 time: 0.031773 Nov 02 16:51:33.679773 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 393/811] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:33 2021] GET /compute/v2.1/servers/6f3b482c-b905-4e66-a4a0-d271e1b9609c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:51:33.680465 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e3100651-5b7a-4fde-b609-55ed06d21d8d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:33.681566 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e3100651-5b7a-4fde-b609-55ed06d21d8d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:33.696403 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e3100651-5b7a-4fde-b609-55ed06d21d8d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:33.696403 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e3100651-5b7a-4fde-b609-55ed06d21d8d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:33.697139 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e3100651-5b7a-4fde-b609-55ed06d21d8d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:33.697781 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e3100651-5b7a-4fde-b609-55ed06d21d8d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:33.742046 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1478834013", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "networks": [{"uuid": "7227b316-334e-41bd-9e6f-4cc3a5e87f31"}]}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:51:33.804055 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.network.neutron [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] validate_networks() for [('7227b316-334e-41bd-9e6f-4cc3a5e87f31', None, None, None, None, None)] {{(pid=127648) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:51:33.869576 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e3100651-5b7a-4fde-b609-55ed06d21d8d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:33.879498 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e3100651-5b7a-4fde-b609-55ed06d21d8d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1658 microversion: 2.1 time: 0.204783 Nov 02 16:51:33.880161 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 419/812] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:33 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1658 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:33.898880 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5ab65d2d-847a-4c24-b956-b38499aba20b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:51:33.907100 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ab65d2d-847a-4c24-b956-b38499aba20b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:33.907441 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ab65d2d-847a-4c24-b956-b38499aba20b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:33.937442 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5ab65d2d-847a-4c24-b956-b38499aba20b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Going to try to start instance {{(pid=127649) start /opt/stack/nova/nova/compute/api.py:2675}} Nov 02 16:51:33.989559 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5ab65d2d-847a-4c24-b956-b38499aba20b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action" status: 202 len: 0 microversion: 2.1 time: 0.095026 Nov 02 16:51:33.990265 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 420/813] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:51:33 2021] POST /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:51:34.000024 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1134b49c-deb3-424a-9f6d-b1f9486b64a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:34.000835 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1134b49c-deb3-424a-9f6d-b1f9486b64a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:34.008534 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1134b49c-deb3-424a-9f6d-b1f9486b64a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:34.009086 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1134b49c-deb3-424a-9f6d-b1f9486b64a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:34.009863 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1134b49c-deb3-424a-9f6d-b1f9486b64a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:34.010474 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1134b49c-deb3-424a-9f6d-b1f9486b64a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:34.174081 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1134b49c-deb3-424a-9f6d-b1f9486b64a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:34.182465 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1134b49c-deb3-424a-9f6d-b1f9486b64a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1667 microversion: 2.1 time: 0.187307 Nov 02 16:51:34.183098 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 421/814] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:33 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1667 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:51:34.728727 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Flavor limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:51:34.730161 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Image limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:51:34.731002 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Flavor pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:51:34.731728 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Image pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:51:34.732398 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:51:34.743877 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:34.744488 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:34.745831 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:34.746283 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:34.767192 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Getting quotas for project 4663a8f2673146cab27e2310dd397954. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:51:34.772453 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Getting quotas for user df270eca855a43da84068be7ce6c25e7 and project 4663a8f2673146cab27e2310dd397954. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:51:34.787147 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Going to run 1 instances... {{(pid=127648) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:51:34.789614 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:51:34.858798 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-86201fc2-60dc-420b-a539-e5e06c7fdbf6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.121685 Nov 02 16:51:34.860279 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 394/815] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:51:33 2021] POST /compute/v2.1/servers => generated 382 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 16:51:34.874884 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3f547b20-456e-422a-bb3c-87164a359657 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:34.874884 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3f547b20-456e-422a-bb3c-87164a359657 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:34.978227 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3f547b20-456e-422a-bb3c-87164a359657 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:34.988062 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3f547b20-456e-422a-bb3c-87164a359657 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1218 microversion: 2.1 time: 0.119476 Nov 02 16:51:34.989194 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 422/816] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:34 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:35.216822 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e119c50f-78d2-4b60-99a1-df9c9cf52591 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:35.217695 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e119c50f-78d2-4b60-99a1-df9c9cf52591 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:35.228346 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e119c50f-78d2-4b60-99a1-df9c9cf52591 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:35.228934 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e119c50f-78d2-4b60-99a1-df9c9cf52591 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:35.230893 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e119c50f-78d2-4b60-99a1-df9c9cf52591 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:35.231887 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e119c50f-78d2-4b60-99a1-df9c9cf52591 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:35.403907 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e119c50f-78d2-4b60-99a1-df9c9cf52591 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:35.412694 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e119c50f-78d2-4b60-99a1-df9c9cf52591 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1667 microversion: 2.1 time: 0.205659 Nov 02 16:51:35.413332 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 395/817] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:35 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1667 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:36.007667 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-651a4ced-e7d9-4517-81a1-2c2bbed98392 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:36.008471 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-651a4ced-e7d9-4517-81a1-2c2bbed98392 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:36.016680 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-651a4ced-e7d9-4517-81a1-2c2bbed98392 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:36.017139 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-651a4ced-e7d9-4517-81a1-2c2bbed98392 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:36.018202 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-651a4ced-e7d9-4517-81a1-2c2bbed98392 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:36.018457 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-651a4ced-e7d9-4517-81a1-2c2bbed98392 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:36.090598 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-651a4ced-e7d9-4517-81a1-2c2bbed98392 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:36.102383 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-651a4ced-e7d9-4517-81a1-2c2bbed98392 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1270 microversion: 2.1 time: 0.098736 Nov 02 16:51:36.103194 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 423/818] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:36 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:36.431828 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5022a350-5b04-487d-9a16-43ba3654d8fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:36.432644 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5022a350-5b04-487d-9a16-43ba3654d8fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:36.440645 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5022a350-5b04-487d-9a16-43ba3654d8fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:36.441122 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5022a350-5b04-487d-9a16-43ba3654d8fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:36.442281 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5022a350-5b04-487d-9a16-43ba3654d8fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:36.442906 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5022a350-5b04-487d-9a16-43ba3654d8fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:36.715649 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5022a350-5b04-487d-9a16-43ba3654d8fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:36.726754 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5022a350-5b04-487d-9a16-43ba3654d8fd tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1671 microversion: 2.1 time: 0.299541 Nov 02 16:51:36.728221 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 396/819] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:36 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1671 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:37.122463 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-309cc5ef-f345-4b7a-9ae7-a688d5b5f277 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:37.123173 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-309cc5ef-f345-4b7a-9ae7-a688d5b5f277 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:37.130149 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-309cc5ef-f345-4b7a-9ae7-a688d5b5f277 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:37.130605 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-309cc5ef-f345-4b7a-9ae7-a688d5b5f277 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:37.131416 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-309cc5ef-f345-4b7a-9ae7-a688d5b5f277 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:37.131898 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-309cc5ef-f345-4b7a-9ae7-a688d5b5f277 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:37.293648 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-309cc5ef-f345-4b7a-9ae7-a688d5b5f277 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:37.302321 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-309cc5ef-f345-4b7a-9ae7-a688d5b5f277 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1318 microversion: 2.1 time: 0.184536 Nov 02 16:51:37.303024 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 424/820] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:37 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:37.703760 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-9cc1f570-f028-4eb6-952a-48a40087712a req-08458149-335f-47fe-b239-6b0454b44875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7467b613-4bac-44d8-b195-09d4eeda75f7", "tag": "12c1cfec-d5bb-4a9d-8e17-b6598044792e"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:51:37.705699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:51:37.705699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:51:37.715511 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-9cc1f570-f028-4eb6-952a-48a40087712a req-08458149-335f-47fe-b239-6b0454b44875 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:37.716123 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-9cc1f570-f028-4eb6-952a-48a40087712a req-08458149-335f-47fe-b239-6b0454b44875 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:37.733760 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-9cc1f570-f028-4eb6-952a-48a40087712a req-08458149-335f-47fe-b239-6b0454b44875 service nova] Creating event network-changed:12c1cfec-d5bb-4a9d-8e17-b6598044792e for instance 7467b613-4bac-44d8-b195-09d4eeda75f7 on hv-cinder-77387 Nov 02 16:51:37.738927 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-9cc1f570-f028-4eb6-952a-48a40087712a req-08458149-335f-47fe-b239-6b0454b44875 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039568 Nov 02 16:51:37.739593 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 397/821] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:51:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:51:38.321592 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-08377158-1102-4d66-b437-d52ac21c2a62 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:38.322320 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-08377158-1102-4d66-b437-d52ac21c2a62 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:38.330787 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-08377158-1102-4d66-b437-d52ac21c2a62 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:38.331248 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-08377158-1102-4d66-b437-d52ac21c2a62 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:38.332081 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-08377158-1102-4d66-b437-d52ac21c2a62 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:38.332557 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-08377158-1102-4d66-b437-d52ac21c2a62 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:38.476932 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-08377158-1102-4d66-b437-d52ac21c2a62 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:38.486265 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-08377158-1102-4d66-b437-d52ac21c2a62 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1318 microversion: 2.1 time: 0.168696 Nov 02 16:51:38.486936 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 425/822] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:38 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:39.505460 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4b479dff-3a47-4b02-9535-210d33525bed tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:39.506198 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4b479dff-3a47-4b02-9535-210d33525bed tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:39.513619 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4b479dff-3a47-4b02-9535-210d33525bed tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:39.514078 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4b479dff-3a47-4b02-9535-210d33525bed tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:39.514871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4b479dff-3a47-4b02-9535-210d33525bed tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:39.515310 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4b479dff-3a47-4b02-9535-210d33525bed tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:39.668548 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4b479dff-3a47-4b02-9535-210d33525bed tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:39.677199 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4b479dff-3a47-4b02-9535-210d33525bed tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1318 microversion: 2.1 time: 0.176893 Nov 02 16:51:39.677846 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 398/823] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:39 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:40.695334 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a56e27f6-7430-4886-b18d-01e9d510875e tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:40.696008 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a56e27f6-7430-4886-b18d-01e9d510875e tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:40.703963 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a56e27f6-7430-4886-b18d-01e9d510875e tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:40.704450 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a56e27f6-7430-4886-b18d-01e9d510875e tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:40.705264 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a56e27f6-7430-4886-b18d-01e9d510875e tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:40.705712 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a56e27f6-7430-4886-b18d-01e9d510875e tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:40.883310 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a56e27f6-7430-4886-b18d-01e9d510875e tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:40.893905 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a56e27f6-7430-4886-b18d-01e9d510875e tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1318 microversion: 2.1 time: 0.202506 Nov 02 16:51:40.894910 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 426/824] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:40 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:41.913677 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-beae551b-bea6-4fbc-9efa-eb30caf76b8d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:41.914477 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-beae551b-bea6-4fbc-9efa-eb30caf76b8d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:41.922130 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-beae551b-bea6-4fbc-9efa-eb30caf76b8d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:41.922595 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-beae551b-bea6-4fbc-9efa-eb30caf76b8d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:41.923406 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-beae551b-bea6-4fbc-9efa-eb30caf76b8d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:41.923855 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-beae551b-bea6-4fbc-9efa-eb30caf76b8d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:42.080433 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-beae551b-bea6-4fbc-9efa-eb30caf76b8d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:42.088760 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-beae551b-bea6-4fbc-9efa-eb30caf76b8d tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1318 microversion: 2.1 time: 0.179149 Nov 02 16:51:42.089443 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 399/825] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:41 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:43.106855 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e4e7479e-e803-4827-95ca-014f87608058 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:43.107600 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e4e7479e-e803-4827-95ca-014f87608058 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:43.114713 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4e7479e-e803-4827-95ca-014f87608058 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:43.115169 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4e7479e-e803-4827-95ca-014f87608058 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:43.116023 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4e7479e-e803-4827-95ca-014f87608058 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:43.116507 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4e7479e-e803-4827-95ca-014f87608058 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:43.279064 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e4e7479e-e803-4827-95ca-014f87608058 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:43.288439 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e4e7479e-e803-4827-95ca-014f87608058 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1318 microversion: 2.1 time: 0.185713 Nov 02 16:51:43.289318 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 427/826] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:43 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:44.307391 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ebd441c5-99eb-4682-b023-f5aea3d6c5d6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:44.308164 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ebd441c5-99eb-4682-b023-f5aea3d6c5d6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:44.315429 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ebd441c5-99eb-4682-b023-f5aea3d6c5d6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:44.316142 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ebd441c5-99eb-4682-b023-f5aea3d6c5d6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:44.316762 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ebd441c5-99eb-4682-b023-f5aea3d6c5d6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:44.317205 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ebd441c5-99eb-4682-b023-f5aea3d6c5d6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:44.473587 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ebd441c5-99eb-4682-b023-f5aea3d6c5d6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:44.485267 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ebd441c5-99eb-4682-b023-f5aea3d6c5d6 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1318 microversion: 2.1 time: 0.181788 Nov 02 16:51:44.486299 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 400/827] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:44 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:45.402130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-f7336586-e51b-45b6-8543-3c20ac5f2416 req-da11dfd8-071d-46a2-9b2c-0f06818dcf28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7467b613-4bac-44d8-b195-09d4eeda75f7", "name": "network-vif-plugged", "status": "completed", "tag": "12c1cfec-d5bb-4a9d-8e17-b6598044792e"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:51:45.403946 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:51:45.403946 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:51:45.412158 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-f7336586-e51b-45b6-8543-3c20ac5f2416 req-da11dfd8-071d-46a2-9b2c-0f06818dcf28 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:45.412651 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-f7336586-e51b-45b6-8543-3c20ac5f2416 req-da11dfd8-071d-46a2-9b2c-0f06818dcf28 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:45.425476 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-f7336586-e51b-45b6-8543-3c20ac5f2416 req-da11dfd8-071d-46a2-9b2c-0f06818dcf28 service nova] Creating event network-vif-plugged:12c1cfec-d5bb-4a9d-8e17-b6598044792e for instance 7467b613-4bac-44d8-b195-09d4eeda75f7 on hv-cinder-77387 Nov 02 16:51:45.430652 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-f7336586-e51b-45b6-8543-3c20ac5f2416 req-da11dfd8-071d-46a2-9b2c-0f06818dcf28 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032819 Nov 02 16:51:45.431323 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 428/828] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:51:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:51:45.504116 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3fe628d2-9326-4997-997c-298d4c6cd609 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:45.505017 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3fe628d2-9326-4997-997c-298d4c6cd609 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:45.512902 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3fe628d2-9326-4997-997c-298d4c6cd609 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:45.513371 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3fe628d2-9326-4997-997c-298d4c6cd609 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:45.514215 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3fe628d2-9326-4997-997c-298d4c6cd609 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:45.514680 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3fe628d2-9326-4997-997c-298d4c6cd609 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:45.719814 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3fe628d2-9326-4997-997c-298d4c6cd609 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:45.728527 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3fe628d2-9326-4997-997c-298d4c6cd609 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1318 microversion: 2.1 time: 0.229039 Nov 02 16:51:45.729164 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 401/829] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:45 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:46.748222 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-168bf14c-19ca-416d-bde7-22449b109c34 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:46.749197 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-168bf14c-19ca-416d-bde7-22449b109c34 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:46.756536 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-168bf14c-19ca-416d-bde7-22449b109c34 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:46.757102 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-168bf14c-19ca-416d-bde7-22449b109c34 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:46.757975 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-168bf14c-19ca-416d-bde7-22449b109c34 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:46.758427 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-168bf14c-19ca-416d-bde7-22449b109c34 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:46.927633 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-168bf14c-19ca-416d-bde7-22449b109c34 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:46.936461 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-168bf14c-19ca-416d-bde7-22449b109c34 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1318 microversion: 2.1 time: 0.193314 Nov 02 16:51:46.937106 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 429/830] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:46 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:51:47.956542 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-19f365d3-3d25-4980-8d53-b3a1b2847a25 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:47.958075 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-19f365d3-3d25-4980-8d53-b3a1b2847a25 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:47.966462 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-19f365d3-3d25-4980-8d53-b3a1b2847a25 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:47.966807 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-19f365d3-3d25-4980-8d53-b3a1b2847a25 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:47.967557 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-19f365d3-3d25-4980-8d53-b3a1b2847a25 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:47.967997 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-19f365d3-3d25-4980-8d53-b3a1b2847a25 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:48.240990 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-19f365d3-3d25-4980-8d53-b3a1b2847a25 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:48.254734 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-19f365d3-3d25-4980-8d53-b3a1b2847a25 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1502 microversion: 2.1 time: 0.302887 Nov 02 16:51:48.255584 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 402/831] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:47 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1502 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:48.889372 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-37a34d56-bbbf-44cb-9efb-89c70ca5511f tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:48.893094 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-37a34d56-bbbf-44cb-9efb-89c70ca5511f tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:48.902133 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-37a34d56-bbbf-44cb-9efb-89c70ca5511f tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:48.902522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-37a34d56-bbbf-44cb-9efb-89c70ca5511f tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:48.905945 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-37a34d56-bbbf-44cb-9efb-89c70ca5511f tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:48.906605 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-37a34d56-bbbf-44cb-9efb-89c70ca5511f tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:48.937098 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-37a34d56-bbbf-44cb-9efb-89c70ca5511f tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Going to try to terminate instance {{(pid=127649) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:51:49.025968 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-37a34d56-bbbf-44cb-9efb-89c70ca5511f tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "DELETE /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 204 len: 0 microversion: 2.1 time: 0.141636 Nov 02 16:51:49.030311 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 430/832] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:51:48 2021] DELETE /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:51:49.036880 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-451736b8-a9f5-4f7d-888b-94ab5dd8cbbc tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:49.038374 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-451736b8-a9f5-4f7d-888b-94ab5dd8cbbc tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:49.047210 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-451736b8-a9f5-4f7d-888b-94ab5dd8cbbc tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:49.047690 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-451736b8-a9f5-4f7d-888b-94ab5dd8cbbc tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:49.048574 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-451736b8-a9f5-4f7d-888b-94ab5dd8cbbc tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:49.049057 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-451736b8-a9f5-4f7d-888b-94ab5dd8cbbc tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:49.315099 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-451736b8-a9f5-4f7d-888b-94ab5dd8cbbc tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:49.328716 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-451736b8-a9f5-4f7d-888b-94ab5dd8cbbc tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1508 microversion: 2.1 time: 0.295767 Nov 02 16:51:49.329736 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 403/833] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:49 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:50.351329 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4b800adb-28cc-4212-b55b-b49780f9a835 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:50.353302 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4b800adb-28cc-4212-b55b-b49780f9a835 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:50.364710 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4b800adb-28cc-4212-b55b-b49780f9a835 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:50.365576 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4b800adb-28cc-4212-b55b-b49780f9a835 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:50.366622 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4b800adb-28cc-4212-b55b-b49780f9a835 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:50.367243 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4b800adb-28cc-4212-b55b-b49780f9a835 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:50.537894 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-4b800adb-28cc-4212-b55b-b49780f9a835 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:50.547929 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4b800adb-28cc-4212-b55b-b49780f9a835 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1508 microversion: 2.1 time: 0.202307 Nov 02 16:51:50.548829 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 431/834] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:50 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:51.572968 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-172b9075-9c34-4b5c-9cde-d45668ea4f48 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:51.576261 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-172b9075-9c34-4b5c-9cde-d45668ea4f48 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:51.591690 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-172b9075-9c34-4b5c-9cde-d45668ea4f48 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:51.592846 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-172b9075-9c34-4b5c-9cde-d45668ea4f48 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:51.594636 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-172b9075-9c34-4b5c-9cde-d45668ea4f48 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:51.595584 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-172b9075-9c34-4b5c-9cde-d45668ea4f48 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:52.033890 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-7fcb9173-20b0-45db-95e1-a733293208a2 req-70cebdc1-2eb7-4a55-8b54-991e43e687f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7467b613-4bac-44d8-b195-09d4eeda75f7", "name": "network-vif-deleted", "tag": "12c1cfec-d5bb-4a9d-8e17-b6598044792e"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:51:52.036920 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:51:52.036920 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:51:52.039822 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-172b9075-9c34-4b5c-9cde-d45668ea4f48 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df270eca855a43da84068be7ce6c25e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4663a8f2673146cab27e2310dd397954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:51:52.059608 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-172b9075-9c34-4b5c-9cde-d45668ea4f48 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 200 len: 1508 microversion: 2.1 time: 0.492723 Nov 02 16:51:52.062426 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 404/835] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:51 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 1508 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:51:52.086125 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-7fcb9173-20b0-45db-95e1-a733293208a2 req-70cebdc1-2eb7-4a55-8b54-991e43e687f8 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:52.086601 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-7fcb9173-20b0-45db-95e1-a733293208a2 req-70cebdc1-2eb7-4a55-8b54-991e43e687f8 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:52.104806 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-7fcb9173-20b0-45db-95e1-a733293208a2 req-70cebdc1-2eb7-4a55-8b54-991e43e687f8 service nova] Creating event network-vif-deleted:12c1cfec-d5bb-4a9d-8e17-b6598044792e for instance 7467b613-4bac-44d8-b195-09d4eeda75f7 on hv-cinder-77387 Nov 02 16:51:52.112116 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-7fcb9173-20b0-45db-95e1-a733293208a2 req-70cebdc1-2eb7-4a55-8b54-991e43e687f8 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085268 Nov 02 16:51:52.113400 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 432/836] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:51:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:51:53.054026 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 16:51:53.054724 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: Tue Nov 2 16:51:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 16:51:53.093497 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ed6db36c-61e6-4dc9-afaf-4b03d4dbbaa0 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:51:53.097172 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ed6db36c-61e6-4dc9-afaf-4b03d4dbbaa0 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] [instance: 7467b613-4bac-44d8-b195-09d4eeda75f7] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:51:53.111612 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ed6db36c-61e6-4dc9-afaf-4b03d4dbbaa0 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:53.112487 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ed6db36c-61e6-4dc9-afaf-4b03d4dbbaa0 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:53.114020 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ed6db36c-61e6-4dc9-afaf-4b03d4dbbaa0 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:51:53.114625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ed6db36c-61e6-4dc9-afaf-4b03d4dbbaa0 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:51:53.143976 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-ed6db36c-61e6-4dc9-afaf-4b03d4dbbaa0 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] HTTP exception thrown: Instance 7467b613-4bac-44d8-b195-09d4eeda75f7 could not be found. Nov 02 16:51:53.144818 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ed6db36c-61e6-4dc9-afaf-4b03d4dbbaa0 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] Returning 404 to user: Instance 7467b613-4bac-44d8-b195-09d4eeda75f7 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:51:53.145915 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ed6db36c-61e6-4dc9-afaf-4b03d4dbbaa0 tempest-VolumesActionsTest-727035873 tempest-VolumesActionsTest-727035873-project] 10.222.0.118 "GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7" status: 404 len: 111 microversion: 2.1 time: 0.059620 Nov 02 16:51:53.146674 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 405/837] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:51:53 2021] GET /compute/v2.1/servers/7467b613-4bac-44d8-b195-09d4eeda75f7 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:52:00.943141 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bcd5c47a-8356-44b6-adf0-4fcdb0b5239b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Action: 'create', calling method: .version_select at 0x7f112f43fc10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-811681611"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:00.998964 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-bcd5c47a-8356-44b6-adf0-4fcdb0b5239b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Getting quotas for project f83b31a72c4f4cc78519ed2dc9bdc400. Resources: {'key_pairs'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:52:01.004831 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-bcd5c47a-8356-44b6-adf0-4fcdb0b5239b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Getting quotas for user da0989d1d66a4c99b6bf4f1820f7c2e4 and project f83b31a72c4f4cc78519ed2dc9bdc400. Resources: {'key_pairs'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:52:01.799385 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-bcd5c47a-8356-44b6-adf0-4fcdb0b5239b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Getting quotas for project f83b31a72c4f4cc78519ed2dc9bdc400. Resources: {'key_pairs'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:52:01.810673 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-bcd5c47a-8356-44b6-adf0-4fcdb0b5239b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Getting quotas for user da0989d1d66a4c99b6bf4f1820f7c2e4 and project f83b31a72c4f4cc78519ed2dc9bdc400. Resources: {'key_pairs'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:52:01.849092 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-bcd5c47a-8356-44b6-adf0-4fcdb0b5239b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 1.278319 Nov 02 16:52:01.850475 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 433/838] 10.222.0.118 () {60 vars in 1162 bytes} [Tue Nov 2 16:52:00 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:18.358573 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d185fac4-cb47-4d9f-9166-5fdbbbf0a1d2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:18.359302 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d185fac4-cb47-4d9f-9166-5fdbbbf0a1d2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:18.366794 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d185fac4-cb47-4d9f-9166-5fdbbbf0a1d2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:18.367256 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d185fac4-cb47-4d9f-9166-5fdbbbf0a1d2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:18.368112 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d185fac4-cb47-4d9f-9166-5fdbbbf0a1d2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:18.368620 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d185fac4-cb47-4d9f-9166-5fdbbbf0a1d2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:18.434305 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d185fac4-cb47-4d9f-9166-5fdbbbf0a1d2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-volume_attachments/a5632629-20b3-4b15-8b28-6940308b7a9a" status: 200 len: 194 microversion: 2.20 time: 0.265469 Nov 02 16:52:18.436567 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 406/839] 10.222.0.118 () {60 vars in 1458 bytes} [Tue Nov 2 16:52:18 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-volume_attachments/a5632629-20b3-4b15-8b28-6940308b7a9a => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:52:18.521771 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-28125dfc-4ce2-4254-94ae-a86b56df5bf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:18.522522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-28125dfc-4ce2-4254-94ae-a86b56df5bf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:18.534952 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-28125dfc-4ce2-4254-94ae-a86b56df5bf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:18.535427 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-28125dfc-4ce2-4254-94ae-a86b56df5bf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:18.536381 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-28125dfc-4ce2-4254-94ae-a86b56df5bf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:18.536802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-28125dfc-4ce2-4254-94ae-a86b56df5bf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:18.653234 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-28125dfc-4ce2-4254-94ae-a86b56df5bf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lazy-loading 'services' on Instance uuid 3df0bde8-504d-42f2-b162-1fb601b26528 {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:52:18.761284 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-28125dfc-4ce2-4254-94ae-a86b56df5bf7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "DELETE /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-volume_attachments/a5632629-20b3-4b15-8b28-6940308b7a9a" status: 202 len: 0 microversion: 2.20 time: 0.244953 Nov 02 16:52:18.762501 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 434/840] 10.222.0.118 () {60 vars in 1461 bytes} [Tue Nov 2 16:52:18 2021] DELETE /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-volume_attachments/a5632629-20b3-4b15-8b28-6940308b7a9a => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:52:18.774374 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-344327a7-3533-466f-bafa-9f44fe280b3b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:18.776169 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-344327a7-3533-466f-bafa-9f44fe280b3b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:18.785740 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-344327a7-3533-466f-bafa-9f44fe280b3b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:18.787503 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-344327a7-3533-466f-bafa-9f44fe280b3b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:18.788555 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-344327a7-3533-466f-bafa-9f44fe280b3b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:18.789100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-344327a7-3533-466f-bafa-9f44fe280b3b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:18.837508 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-344327a7-3533-466f-bafa-9f44fe280b3b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069341 Nov 02 16:52:18.840249 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 407/841] 10.222.0.118 () {60 vars in 1347 bytes} [Tue Nov 2 16:52:18 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:52:19.642431 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9e925cf8-ae75-4f47-abf9-9d0adf9d34bc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-461784665"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:19.643231 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9e925cf8-ae75-4f47-abf9-9d0adf9d34bc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:19.656283 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9e925cf8-ae75-4f47-abf9-9d0adf9d34bc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:19.656283 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9e925cf8-ae75-4f47-abf9-9d0adf9d34bc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:19.656283 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9e925cf8-ae75-4f47-abf9-9d0adf9d34bc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:19.656283 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9e925cf8-ae75-4f47-abf9-9d0adf9d34bc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:19.847662 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.network.security_group_api [None req-9e925cf8-ae75-4f47-abf9-9d0adf9d34bc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Removing security group 51a5be46-46b8-4574-9203-4a50b68dea4b from port dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e Nov 02 16:52:19.851602 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ea9fdb75-daf0-4c50-8b51-c9cd07383d98 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:19.855067 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ea9fdb75-daf0-4c50-8b51-c9cd07383d98 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:19.863349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ea9fdb75-daf0-4c50-8b51-c9cd07383d98 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:19.863981 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ea9fdb75-daf0-4c50-8b51-c9cd07383d98 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:19.864681 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ea9fdb75-daf0-4c50-8b51-c9cd07383d98 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:19.865147 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ea9fdb75-daf0-4c50-8b51-c9cd07383d98 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:19.916383 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ea9fdb75-daf0-4c50-8b51-c9cd07383d98 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069338 Nov 02 16:52:19.919244 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 408/842] 10.222.0.118 () {60 vars in 1347 bytes} [Tue Nov 2 16:52:19 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:52:20.417402 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9e925cf8-ae75-4f47-abf9-9d0adf9d34bc tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "POST /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/action" status: 202 len: 0 microversion: 2.1 time: 0.779756 Nov 02 16:52:20.429182 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 435/843] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:52:19 2021] POST /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/action => generated 0 bytes in 794 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:52:20.564049 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-a3addc77-53ce-488c-9370-8bd969c434cc req-e53973cb-fc7b-4af8-aa3e-98bcd1365313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd91cbf0-2d7e-4a11-9073-6e61ccfc7295", "tag": "dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:20.568157 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:52:20.568157 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:52:20.603080 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-a3addc77-53ce-488c-9370-8bd969c434cc req-e53973cb-fc7b-4af8-aa3e-98bcd1365313 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:20.604409 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-a3addc77-53ce-488c-9370-8bd969c434cc req-e53973cb-fc7b-4af8-aa3e-98bcd1365313 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:20.673079 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-a3addc77-53ce-488c-9370-8bd969c434cc req-e53973cb-fc7b-4af8-aa3e-98bcd1365313 service nova] Creating event network-changed:dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e for instance fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 on hv-cinder-77387 Nov 02 16:52:20.687279 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-a3addc77-53ce-488c-9370-8bd969c434cc req-e53973cb-fc7b-4af8-aa3e-98bcd1365313 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232337 Nov 02 16:52:20.688901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 409/844] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:52:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:52:20.931614 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-15d7c405-d5ca-4385-a8ed-e7450f295d6c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:20.933982 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-15d7c405-d5ca-4385-a8ed-e7450f295d6c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:20.948442 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-15d7c405-d5ca-4385-a8ed-e7450f295d6c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:20.954924 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-15d7c405-d5ca-4385-a8ed-e7450f295d6c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:20.956269 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-15d7c405-d5ca-4385-a8ed-e7450f295d6c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:20.960957 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-15d7c405-d5ca-4385-a8ed-e7450f295d6c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:21.083988 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-15d7c405-d5ca-4385-a8ed-e7450f295d6c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.156768 Nov 02 16:52:21.113179 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 436/845] 10.222.0.118 () {60 vars in 1347 bytes} [Tue Nov 2 16:52:20 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528/os-volume_attachments => generated 25 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:21.219409 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7b367c95-333f-4410-b436-a547248703ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:21.221089 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7b367c95-333f-4410-b436-a547248703ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:21.261535 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7b367c95-333f-4410-b436-a547248703ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:21.266430 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7b367c95-333f-4410-b436-a547248703ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:21.268612 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7b367c95-333f-4410-b436-a547248703ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:21.270647 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7b367c95-333f-4410-b436-a547248703ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:21.373009 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7b367c95-333f-4410-b436-a547248703ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Going to try to terminate instance {{(pid=127648) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:52:21.548114 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7b367c95-333f-4410-b436-a547248703ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "DELETE /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 204 len: 0 microversion: 2.20 time: 0.336750 Nov 02 16:52:21.549822 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 410/846] 10.222.0.118 () {60 vars in 1284 bytes} [Tue Nov 2 16:52:21 2021] DELETE /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 16:52:21.561051 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a8644e74-29b4-4d0e-a5ec-ec9171e42d68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:21.561704 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a8644e74-29b4-4d0e-a5ec-ec9171e42d68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:21.579127 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a8644e74-29b4-4d0e-a5ec-ec9171e42d68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:21.579592 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a8644e74-29b4-4d0e-a5ec-ec9171e42d68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:21.582142 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a8644e74-29b4-4d0e-a5ec-ec9171e42d68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:21.582901 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a8644e74-29b4-4d0e-a5ec-ec9171e42d68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:21.926711 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a8644e74-29b4-4d0e-a5ec-ec9171e42d68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:21.946396 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a8644e74-29b4-4d0e-a5ec-ec9171e42d68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:21.952882 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a8644e74-29b4-4d0e-a5ec-ec9171e42d68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:21.957052 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a8644e74-29b4-4d0e-a5ec-ec9171e42d68 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.400428 Nov 02 16:52:21.959294 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 437/847] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:21 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:22.362396 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7332ac1b-7603-4e6b-9577-9cfc07221c3c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:22.364270 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7332ac1b-7603-4e6b-9577-9cfc07221c3c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:22.372765 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7332ac1b-7603-4e6b-9577-9cfc07221c3c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:22.373643 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7332ac1b-7603-4e6b-9577-9cfc07221c3c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:22.374775 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7332ac1b-7603-4e6b-9577-9cfc07221c3c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:22.378337 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7332ac1b-7603-4e6b-9577-9cfc07221c3c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:22.500484 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.objects.instance [None req-7332ac1b-7603-4e6b-9577-9cfc07221c3c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lazy-loading 'services' on Instance uuid fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 {{(pid=127648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:52:22.606713 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7332ac1b-7603-4e6b-9577-9cfc07221c3c tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "DELETE /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/os-volume_attachments/dccd7c60-d08e-4063-8677-210a20e54cb2" status: 202 len: 0 microversion: 2.1 time: 0.253311 Nov 02 16:52:22.618443 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-329ee8cc-45f9-483f-b94c-7338ebe4810f tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:22.620914 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-329ee8cc-45f9-483f-b94c-7338ebe4810f tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:22.625172 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 411/848] 10.222.0.118 () {58 vars in 1420 bytes} [Tue Nov 2 16:52:22 2021] DELETE /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/os-volume_attachments/dccd7c60-d08e-4063-8677-210a20e54cb2 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:52:22.638220 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-329ee8cc-45f9-483f-b94c-7338ebe4810f tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:22.641910 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-329ee8cc-45f9-483f-b94c-7338ebe4810f tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:22.644654 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-329ee8cc-45f9-483f-b94c-7338ebe4810f tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:22.645146 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-329ee8cc-45f9-483f-b94c-7338ebe4810f tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:22.715166 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-515fc81c-662e-41a6-82d8-a9d16be412d6 req-5b260a8b-00c7-4a88-8b16-a1eaabd1316b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd91cbf0-2d7e-4a11-9073-6e61ccfc7295", "tag": "dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:22.724659 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:52:22.724659 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:52:22.738608 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-329ee8cc-45f9-483f-b94c-7338ebe4810f tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122702 Nov 02 16:52:22.741905 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 438/849] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:52:22 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:52:22.772322 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-515fc81c-662e-41a6-82d8-a9d16be412d6 req-5b260a8b-00c7-4a88-8b16-a1eaabd1316b service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:22.776890 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-515fc81c-662e-41a6-82d8-a9d16be412d6 req-5b260a8b-00c7-4a88-8b16-a1eaabd1316b service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:22.793379 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-515fc81c-662e-41a6-82d8-a9d16be412d6 req-5b260a8b-00c7-4a88-8b16-a1eaabd1316b service nova] Creating event network-changed:dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e for instance fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 on hv-cinder-77387 Nov 02 16:52:22.800078 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-515fc81c-662e-41a6-82d8-a9d16be412d6 req-5b260a8b-00c7-4a88-8b16-a1eaabd1316b service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092764 Nov 02 16:52:22.801151 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 412/850] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:52:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:52:22.979574 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c0bf9c65-8947-46a1-95c8-0b7da74d38e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:22.982305 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c0bf9c65-8947-46a1-95c8-0b7da74d38e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:22.999485 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c0bf9c65-8947-46a1-95c8-0b7da74d38e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:23.002249 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c0bf9c65-8947-46a1-95c8-0b7da74d38e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:23.006427 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c0bf9c65-8947-46a1-95c8-0b7da74d38e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:23.007311 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c0bf9c65-8947-46a1-95c8-0b7da74d38e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:23.313535 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c0bf9c65-8947-46a1-95c8-0b7da74d38e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:23.325769 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c0bf9c65-8947-46a1-95c8-0b7da74d38e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:23.327952 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c0bf9c65-8947-46a1-95c8-0b7da74d38e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:23.329546 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c0bf9c65-8947-46a1-95c8-0b7da74d38e6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.355262 Nov 02 16:52:23.330849 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 439/851] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:22 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:23.755486 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-255cf2b4-d36b-4e7f-8a49-1da8b995c4c9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:23.756659 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-255cf2b4-d36b-4e7f-8a49-1da8b995c4c9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:23.773882 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-255cf2b4-d36b-4e7f-8a49-1da8b995c4c9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:23.774925 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-255cf2b4-d36b-4e7f-8a49-1da8b995c4c9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:23.776791 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-255cf2b4-d36b-4e7f-8a49-1da8b995c4c9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:23.777508 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-255cf2b4-d36b-4e7f-8a49-1da8b995c4c9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:23.824801 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-255cf2b4-d36b-4e7f-8a49-1da8b995c4c9 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071203 Nov 02 16:52:23.842862 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 413/852] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:52:23 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:52:23.849051 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-55636354-0ca8-4ff3-bf56-8888f00c56db tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:23.850481 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-55636354-0ca8-4ff3-bf56-8888f00c56db tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:23.864227 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-55636354-0ca8-4ff3-bf56-8888f00c56db tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:23.865252 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-55636354-0ca8-4ff3-bf56-8888f00c56db tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:23.866499 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-55636354-0ca8-4ff3-bf56-8888f00c56db tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:23.867212 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-55636354-0ca8-4ff3-bf56-8888f00c56db tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:23.976086 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-55636354-0ca8-4ff3-bf56-8888f00c56db tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] HTTP exception thrown: Instance fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 is not attached to volume dccd7c60-d08e-4063-8677-210a20e54cb2 Nov 02 16:52:23.977240 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-55636354-0ca8-4ff3-bf56-8888f00c56db tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Returning 404 to user: Instance fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 is not attached to volume dccd7c60-d08e-4063-8677-210a20e54cb2 {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:52:23.979087 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-55636354-0ca8-4ff3-bf56-8888f00c56db tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "DELETE /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/os-volume_attachments/dccd7c60-d08e-4063-8677-210a20e54cb2" status: 404 len: 154 microversion: 2.1 time: 0.134706 Nov 02 16:52:23.981226 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 440/853] 10.222.0.118 () {58 vars in 1420 bytes} [Tue Nov 2 16:52:23 2021] DELETE /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295/os-volume_attachments/dccd7c60-d08e-4063-8677-210a20e54cb2 => generated 154 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:52:24.352055 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-380f7fd1-e7a2-4e5b-9a4d-5aecc46d9781 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:24.354257 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-380f7fd1-e7a2-4e5b-9a4d-5aecc46d9781 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:24.374265 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-380f7fd1-e7a2-4e5b-9a4d-5aecc46d9781 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:24.374902 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-380f7fd1-e7a2-4e5b-9a4d-5aecc46d9781 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:24.375872 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-380f7fd1-e7a2-4e5b-9a4d-5aecc46d9781 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:24.376882 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-380f7fd1-e7a2-4e5b-9a4d-5aecc46d9781 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:24.717850 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-380f7fd1-e7a2-4e5b-9a4d-5aecc46d9781 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:24.734039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-380f7fd1-e7a2-4e5b-9a4d-5aecc46d9781 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:24.735966 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-380f7fd1-e7a2-4e5b-9a4d-5aecc46d9781 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:24.737286 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-380f7fd1-e7a2-4e5b-9a4d-5aecc46d9781 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1728 microversion: 2.20 time: 0.391487 Nov 02 16:52:24.737911 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 414/854] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:24 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1728 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:25.173937 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b0523079-be51-46a7-a4e0-4cee0dd89298 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:25.175277 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b0523079-be51-46a7-a4e0-4cee0dd89298 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:25.185267 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b0523079-be51-46a7-a4e0-4cee0dd89298 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:25.186053 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b0523079-be51-46a7-a4e0-4cee0dd89298 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:25.187107 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b0523079-be51-46a7-a4e0-4cee0dd89298 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:25.187846 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b0523079-be51-46a7-a4e0-4cee0dd89298 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:25.221456 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b0523079-be51-46a7-a4e0-4cee0dd89298 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Going to try to terminate instance {{(pid=127649) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:52:25.360321 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b0523079-be51-46a7-a4e0-4cee0dd89298 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "DELETE /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 204 len: 0 microversion: 2.1 time: 0.190232 Nov 02 16:52:25.373540 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a3434de6-bde0-4af1-b104-afda30e2d6c0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:25.375766 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a3434de6-bde0-4af1-b104-afda30e2d6c0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:25.380626 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 441/855] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:52:25 2021] DELETE /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:52:25.391526 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a3434de6-bde0-4af1-b104-afda30e2d6c0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:25.392338 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a3434de6-bde0-4af1-b104-afda30e2d6c0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:25.393468 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a3434de6-bde0-4af1-b104-afda30e2d6c0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:25.395817 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a3434de6-bde0-4af1-b104-afda30e2d6c0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:25.817094 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a3434de6-bde0-4af1-b104-afda30e2d6c0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:25.834427 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a3434de6-bde0-4af1-b104-afda30e2d6c0 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1557 microversion: 2.1 time: 0.465413 Nov 02 16:52:25.835079 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 415/856] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:25 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1557 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:25.851988 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-afc5ceee-b33f-4cbb-9ef6-b099ce32dfef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:25.853750 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-afc5ceee-b33f-4cbb-9ef6-b099ce32dfef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:25.865818 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-afc5ceee-b33f-4cbb-9ef6-b099ce32dfef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:25.871646 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-afc5ceee-b33f-4cbb-9ef6-b099ce32dfef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:25.872796 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-afc5ceee-b33f-4cbb-9ef6-b099ce32dfef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:25.873889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-afc5ceee-b33f-4cbb-9ef6-b099ce32dfef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:25.923072 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-e71ab900-326d-4cb7-abd1-84948dc3856d req-b6ac4365-dfd3-4299-9c98-8cad9d0b3e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df0bde8-504d-42f2-b162-1fb601b26528", "name": "network-vif-deleted", "tag": "6a36918e-caa7-42ed-b923-c3a049049148"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:25.925281 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:52:25.925281 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:52:25.940652 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-e71ab900-326d-4cb7-abd1-84948dc3856d req-b6ac4365-dfd3-4299-9c98-8cad9d0b3e10 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:25.945401 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-e71ab900-326d-4cb7-abd1-84948dc3856d req-b6ac4365-dfd3-4299-9c98-8cad9d0b3e10 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:25.970335 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-e71ab900-326d-4cb7-abd1-84948dc3856d req-b6ac4365-dfd3-4299-9c98-8cad9d0b3e10 service nova] Creating event network-vif-deleted:6a36918e-caa7-42ed-b923-c3a049049148 for instance 3df0bde8-504d-42f2-b162-1fb601b26528 on hv-cinder-77387 Nov 02 16:52:25.996964 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-e71ab900-326d-4cb7-abd1-84948dc3856d req-b6ac4365-dfd3-4299-9c98-8cad9d0b3e10 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254224 Nov 02 16:52:25.998159 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 442/857] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:52:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:52:26.015999 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-afc5ceee-b33f-4cbb-9ef6-b099ce32dfef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:26.036247 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-afc5ceee-b33f-4cbb-9ef6-b099ce32dfef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:26.047141 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-afc5ceee-b33f-4cbb-9ef6-b099ce32dfef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:26.049403 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-afc5ceee-b33f-4cbb-9ef6-b099ce32dfef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 200 len: 1371 microversion: 2.20 time: 0.211937 Nov 02 16:52:26.069012 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 416/858] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:25 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:26.856677 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5db1044c-92a7-484b-8917-c22e60d79f91 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:26.858461 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5db1044c-92a7-484b-8917-c22e60d79f91 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:26.881751 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5db1044c-92a7-484b-8917-c22e60d79f91 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:26.882650 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5db1044c-92a7-484b-8917-c22e60d79f91 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:26.883780 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5db1044c-92a7-484b-8917-c22e60d79f91 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:26.884506 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5db1044c-92a7-484b-8917-c22e60d79f91 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:27.074030 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-42eb9954-ff8c-4d86-835b-ec6282d692ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:27.079930 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-42eb9954-ff8c-4d86-835b-ec6282d692ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:27.089628 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5db1044c-92a7-484b-8917-c22e60d79f91 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:27.099970 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5db1044c-92a7-484b-8917-c22e60d79f91 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1557 microversion: 2.1 time: 0.249193 Nov 02 16:52:27.100708 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 443/859] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:26 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1557 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:27.102405 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-42eb9954-ff8c-4d86-835b-ec6282d692ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:27.104155 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-42eb9954-ff8c-4d86-835b-ec6282d692ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:27.105503 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-42eb9954-ff8c-4d86-835b-ec6282d692ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:27.106169 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-42eb9954-ff8c-4d86-835b-ec6282d692ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:27.133201 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-42eb9954-ff8c-4d86-835b-ec6282d692ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] HTTP exception thrown: Instance 3df0bde8-504d-42f2-b162-1fb601b26528 could not be found. Nov 02 16:52:27.134038 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-42eb9954-ff8c-4d86-835b-ec6282d692ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Returning 404 to user: Instance 3df0bde8-504d-42f2-b162-1fb601b26528 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:52:27.136397 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-42eb9954-ff8c-4d86-835b-ec6282d692ce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 404 len: 111 microversion: 2.20 time: 0.067726 Nov 02 16:52:27.137892 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 417/860] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:27 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 16:52:27.149109 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8f29d41e-ae7f-4005-bd3d-e37a13917dee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '.version_select at 0x7f112f5c1e50>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:27.184758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8f29d41e-ae7f-4005-bd3d-e37a13917dee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377233749" status: 204 len: 0 microversion: 2.20 time: 0.041105 Nov 02 16:52:27.190667 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 444/861] 10.222.0.118 () {60 vars in 1266 bytes} [Tue Nov 2 16:52:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377233749 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 16:52:28.121888 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-41d5711a-a34a-4509-98e6-7f432bec1e75 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:28.123560 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-41d5711a-a34a-4509-98e6-7f432bec1e75 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:28.141643 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-41d5711a-a34a-4509-98e6-7f432bec1e75 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:28.142780 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-41d5711a-a34a-4509-98e6-7f432bec1e75 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:28.145796 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-41d5711a-a34a-4509-98e6-7f432bec1e75 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:28.146682 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-41d5711a-a34a-4509-98e6-7f432bec1e75 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:28.418817 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e81a9e40-3da7-4b99-9064-74b29632a828 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'create', calling method: .version_select at 0x7f112f7efd30>, body: {"keypair": {"name": "tempest-keypair-1053567169"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:28.452991 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-e81a9e40-3da7-4b99-9064-74b29632a828 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Getting quotas for project 5cc524f131464fe097cff64187071316. Resources: {'key_pairs'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:52:28.459446 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-e81a9e40-3da7-4b99-9064-74b29632a828 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Getting quotas for user ef90ae7586e94458bfffbae21ae6b9f5 and project 5cc524f131464fe097cff64187071316. Resources: {'key_pairs'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:52:28.491437 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-41d5711a-a34a-4509-98e6-7f432bec1e75 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:28.507664 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-41d5711a-a34a-4509-98e6-7f432bec1e75 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1557 microversion: 2.1 time: 0.390605 Nov 02 16:52:28.511609 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 418/862] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:28 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1557 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:28.828275 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-e81a9e40-3da7-4b99-9064-74b29632a828 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Getting quotas for project 5cc524f131464fe097cff64187071316. Resources: {'key_pairs'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:52:28.834865 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-e81a9e40-3da7-4b99-9064-74b29632a828 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Getting quotas for user ef90ae7586e94458bfffbae21ae6b9f5 and project 5cc524f131464fe097cff64187071316. Resources: {'key_pairs'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:52:28.866683 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e81a9e40-3da7-4b99-9064-74b29632a828 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.457548 Nov 02 16:52:28.870189 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 445/863] 10.222.0.118 () {62 vars in 1203 bytes} [Tue Nov 2 16:52:28 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 463 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 02 16:52:29.530459 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f4c9a57e-84b1-4306-bd0a-776852c98800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:29.531309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f4c9a57e-84b1-4306-bd0a-776852c98800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:29.541327 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f4c9a57e-84b1-4306-bd0a-776852c98800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:29.543558 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f4c9a57e-84b1-4306-bd0a-776852c98800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:29.544716 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f4c9a57e-84b1-4306-bd0a-776852c98800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:29.546185 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f4c9a57e-84b1-4306-bd0a-776852c98800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:29.723313 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-98bee81f-5453-4c6b-b6fe-614f0c2ee086 req-ab6086af-93c0-4bf1-aa58-7d123f2c2e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd91cbf0-2d7e-4a11-9073-6e61ccfc7295", "name": "network-vif-deleted", "tag": "dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:29.726319 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:52:29.726319 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:52:29.741749 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f4c9a57e-84b1-4306-bd0a-776852c98800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6140c6f52e2041aaa0a99a208c959b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078aa8372f994f1eafe3013d58d8c979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:29.753680 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f4c9a57e-84b1-4306-bd0a-776852c98800 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 200 len: 1515 microversion: 2.1 time: 0.227836 Nov 02 16:52:29.753809 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 419/864] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:29 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 1515 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:29.770202 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-98bee81f-5453-4c6b-b6fe-614f0c2ee086 req-ab6086af-93c0-4bf1-aa58-7d123f2c2e58 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:29.771223 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-98bee81f-5453-4c6b-b6fe-614f0c2ee086 req-ab6086af-93c0-4bf1-aa58-7d123f2c2e58 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:29.810866 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-98bee81f-5453-4c6b-b6fe-614f0c2ee086 req-ab6086af-93c0-4bf1-aa58-7d123f2c2e58 service nova] Creating event network-vif-deleted:dca793b9-ddbd-46c1-bbf7-dc9fcc542d1e for instance fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 on hv-cinder-77387 Nov 02 16:52:29.828245 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-98bee81f-5453-4c6b-b6fe-614f0c2ee086 req-ab6086af-93c0-4bf1-aa58-7d123f2c2e58 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109218 Nov 02 16:52:29.829176 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 446/865] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:52:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:52:30.774316 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b1452484-842b-41ab-a551-5260e4050403 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:30.775239 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b1452484-842b-41ab-a551-5260e4050403 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] [instance: fd91cbf0-2d7e-4a11-9073-6e61ccfc7295] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:30.785265 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b1452484-842b-41ab-a551-5260e4050403 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:30.785736 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b1452484-842b-41ab-a551-5260e4050403 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:30.791804 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b1452484-842b-41ab-a551-5260e4050403 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:30.793153 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b1452484-842b-41ab-a551-5260e4050403 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:30.815699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-b1452484-842b-41ab-a551-5260e4050403 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] HTTP exception thrown: Instance fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 could not be found. Nov 02 16:52:30.818740 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b1452484-842b-41ab-a551-5260e4050403 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Returning 404 to user: Instance fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:52:30.826007 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b1452484-842b-41ab-a551-5260e4050403 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295" status: 404 len: 111 microversion: 2.1 time: 0.052166 Nov 02 16:52:30.826007 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 420/866] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:30 2021] GET /compute/v2.1/servers/fd91cbf0-2d7e-4a11-9073-6e61ccfc7295 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:52:30.831990 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b056c66a-5956-4b80-8ab4-56b69edaa962 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] Calling method '.version_select at 0x7f112f4b3ee0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:30.860854 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b056c66a-5956-4b80-8ab4-56b69edaa962 tempest-TestMinimumBasicScenario-757607371 tempest-TestMinimumBasicScenario-757607371-project] 10.222.0.118 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1485977986" status: 202 len: 0 microversion: 2.1 time: 0.033409 Nov 02 16:52:30.862955 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 447/867] 10.222.0.118 () {58 vars in 1276 bytes} [Tue Nov 2 16:52:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1485977986 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:52:30.891078 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-367159033", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2642968c-324e-4035-9dba-a5695e42fc1f"}], "security_groups": [{"name": "tempest-securitygroup--73545175"}], "key_name": "tempest-keypair-1053567169", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:31.156147 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.network.neutron [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] validate_networks() for [('2642968c-324e-4035-9dba-a5695e42fc1f', None, None, None, None, None)] {{(pid=127648) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:52:31.263288 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-662828912", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-811681611", "security_groups": [{"name": "tempest-secgroup-smoke-10426531"}], "block_device_mapping_v2": [{"uuid": "57f04180-8872-4240-87cd-910abf7e302a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ac5452b3-7329-433e-af1f-df17acea3828"}]}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:31.430106 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.network.neutron [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] validate_networks() for [('ac5452b3-7329-433e-af1f-df17acea3828', None, None, None, None, None)] {{(pid=127649) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:52:31.787448 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Flavor limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:52:31.788688 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Image limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:52:31.789194 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Flavor pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:52:31.789619 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Image pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:52:31.790050 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:52:31.802131 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:31.802959 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:31.804684 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:31.806790 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:31.832886 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Getting quotas for project 5cc524f131464fe097cff64187071316. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:52:31.840388 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Getting quotas for user ef90ae7586e94458bfffbae21ae6b9f5 and project 5cc524f131464fe097cff64187071316. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:52:31.858022 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Going to run 1 instances... {{(pid=127648) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:52:31.860711 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:52:31.914958 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c30c86ba-4207-4b45-a698-c9580e0cf7a7 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.030979 Nov 02 16:52:31.921122 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 421/868] 10.222.0.118 () {62 vars in 1192 bytes} [Tue Nov 2 16:52:30 2021] POST /compute/v2.1/servers => generated 402 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Nov 02 16:52:31.926557 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ae2d57ac-ce62-443d-8c62-edba1b301061 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:31.927477 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ae2d57ac-ce62-443d-8c62-edba1b301061 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:31.947179 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Flavor limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:52:31.947951 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Image limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:52:31.948477 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Flavor pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:52:31.948936 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Image pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:52:31.949419 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:52:31.962991 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:31.963462 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:31.964339 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:31.964772 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:31.985413 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Getting quotas for project f83b31a72c4f4cc78519ed2dc9bdc400. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:52:31.989980 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Getting quotas for user da0989d1d66a4c99b6bf4f1820f7c2e4 and project f83b31a72c4f4cc78519ed2dc9bdc400. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:52:32.028973 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ae2d57ac-ce62-443d-8c62-edba1b301061 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:32.037794 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ae2d57ac-ce62-443d-8c62-edba1b301061 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:32.039521 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ae2d57ac-ce62-443d-8c62-edba1b301061 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:32.041838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ae2d57ac-ce62-443d-8c62-edba1b301061 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1285 microversion: 2.20 time: 0.119570 Nov 02 16:52:32.042768 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 422/869] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:31 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:32.062183 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Going to run 1 instances... {{(pid=127649) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:52:32.064944 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57f04180-8872-4240-87cd-910abf7e302a',volume_size=None,volume_type=None)] {{(pid=127649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:52:32.262554 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fdc51f87-9e5e-466e-bbf4-aaf1b0f64d13 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.003565 Nov 02 16:52:32.270422 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 448/870] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:52:31 2021] POST /compute/v2.1/servers => generated 406 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 16:52:32.276675 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9e17a192-32d2-444f-bf42-6c101ad09574 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:32.278536 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9e17a192-32d2-444f-bf42-6c101ad09574 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:32.411830 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9e17a192-32d2-444f-bf42-6c101ad09574 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:32.426679 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9e17a192-32d2-444f-bf42-6c101ad09574 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1096 microversion: 2.1 time: 0.154217 Nov 02 16:52:32.454893 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 423/871] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:32 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1096 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:33.064505 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ec816ca7-5f83-48af-b9e8-ce30afdc0312 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:33.066232 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ec816ca7-5f83-48af-b9e8-ce30afdc0312 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:33.077130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec816ca7-5f83-48af-b9e8-ce30afdc0312 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:33.077661 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec816ca7-5f83-48af-b9e8-ce30afdc0312 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:33.078589 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec816ca7-5f83-48af-b9e8-ce30afdc0312 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:33.079475 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec816ca7-5f83-48af-b9e8-ce30afdc0312 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:33.187768 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ec816ca7-5f83-48af-b9e8-ce30afdc0312 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:33.216693 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ec816ca7-5f83-48af-b9e8-ce30afdc0312 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:33.218397 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ec816ca7-5f83-48af-b9e8-ce30afdc0312 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:33.219672 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ec816ca7-5f83-48af-b9e8-ce30afdc0312 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1337 microversion: 2.20 time: 0.161955 Nov 02 16:52:33.223411 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 449/872] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:33 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1337 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:33.450391 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b27b0292-b25e-4b7f-a429-743f53e27436 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:33.452207 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b27b0292-b25e-4b7f-a429-743f53e27436 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:33.471406 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b27b0292-b25e-4b7f-a429-743f53e27436 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:33.477340 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b27b0292-b25e-4b7f-a429-743f53e27436 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:33.486573 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b27b0292-b25e-4b7f-a429-743f53e27436 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:33.487657 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b27b0292-b25e-4b7f-a429-743f53e27436 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:33.627927 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b27b0292-b25e-4b7f-a429-743f53e27436 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:33.639843 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b27b0292-b25e-4b7f-a429-743f53e27436 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1194 microversion: 2.1 time: 0.195593 Nov 02 16:52:33.640846 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 424/873] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:33 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1194 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:34.252145 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7d2adb9c-6bd4-4599-b97f-50eba599df8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:34.252953 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7d2adb9c-6bd4-4599-b97f-50eba599df8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:34.267049 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7d2adb9c-6bd4-4599-b97f-50eba599df8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:34.270662 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7d2adb9c-6bd4-4599-b97f-50eba599df8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:34.272432 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7d2adb9c-6bd4-4599-b97f-50eba599df8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:34.273113 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7d2adb9c-6bd4-4599-b97f-50eba599df8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:34.661277 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4c363399-b08e-40d9-a906-888907df6918 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:34.662838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4c363399-b08e-40d9-a906-888907df6918 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:34.677111 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4c363399-b08e-40d9-a906-888907df6918 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:34.684757 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4c363399-b08e-40d9-a906-888907df6918 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:34.695839 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4c363399-b08e-40d9-a906-888907df6918 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:34.697255 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4c363399-b08e-40d9-a906-888907df6918 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:34.830750 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4c363399-b08e-40d9-a906-888907df6918 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:34.847833 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4c363399-b08e-40d9-a906-888907df6918 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1212 microversion: 2.1 time: 0.191158 Nov 02 16:52:34.856918 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 425/874] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:34 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1212 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:35.073836 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7d2adb9c-6bd4-4599-b97f-50eba599df8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:35.093323 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7d2adb9c-6bd4-4599-b97f-50eba599df8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:35.095838 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7d2adb9c-6bd4-4599-b97f-50eba599df8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:35.097355 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7d2adb9c-6bd4-4599-b97f-50eba599df8f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1343 microversion: 2.20 time: 0.853415 Nov 02 16:52:35.098231 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 450/875] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:34 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1343 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:35.874901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ad2db314-1280-40c0-87f0-99ce72d49d2b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:35.876655 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ad2db314-1280-40c0-87f0-99ce72d49d2b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:35.894702 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ad2db314-1280-40c0-87f0-99ce72d49d2b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:35.895177 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ad2db314-1280-40c0-87f0-99ce72d49d2b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:35.896311 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ad2db314-1280-40c0-87f0-99ce72d49d2b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:35.896970 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ad2db314-1280-40c0-87f0-99ce72d49d2b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:36.121687 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9fb6ae00-2176-4b21-8e1d-0e811eff53f2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:36.122412 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9fb6ae00-2176-4b21-8e1d-0e811eff53f2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:36.137776 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9fb6ae00-2176-4b21-8e1d-0e811eff53f2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:36.142518 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9fb6ae00-2176-4b21-8e1d-0e811eff53f2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:36.145048 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9fb6ae00-2176-4b21-8e1d-0e811eff53f2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:36.146396 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9fb6ae00-2176-4b21-8e1d-0e811eff53f2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:36.428137 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-9fb6ae00-2176-4b21-8e1d-0e811eff53f2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:36.444774 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-9fb6ae00-2176-4b21-8e1d-0e811eff53f2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:36.447113 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-9fb6ae00-2176-4b21-8e1d-0e811eff53f2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:36.448554 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9fb6ae00-2176-4b21-8e1d-0e811eff53f2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1409 microversion: 2.20 time: 0.331661 Nov 02 16:52:36.450731 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 451/876] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:36 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1409 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:36.761680 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ad2db314-1280-40c0-87f0-99ce72d49d2b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:36.805539 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ad2db314-1280-40c0-87f0-99ce72d49d2b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1266 microversion: 2.1 time: 0.936674 Nov 02 16:52:36.813047 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 426/877] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:35 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1266 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:36.830848 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-787be6ec-e420-4ac7-8558-25154f4173d0 req-ed051b10-b29b-4878-92f4-5b7f4ac349e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc9451a-ff42-4d58-8086-84efeda40e0b", "tag": "38f4c5ac-fd67-4d6a-bcb0-06b8456ad406"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:36.833119 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:52:36.833119 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:52:36.847333 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-787be6ec-e420-4ac7-8558-25154f4173d0 req-ed051b10-b29b-4878-92f4-5b7f4ac349e1 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:36.848087 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-787be6ec-e420-4ac7-8558-25154f4173d0 req-ed051b10-b29b-4878-92f4-5b7f4ac349e1 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:36.877445 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-787be6ec-e420-4ac7-8558-25154f4173d0 req-ed051b10-b29b-4878-92f4-5b7f4ac349e1 service nova] Creating event network-changed:38f4c5ac-fd67-4d6a-bcb0-06b8456ad406 for instance 0cc9451a-ff42-4d58-8086-84efeda40e0b on hv-cinder-77387 Nov 02 16:52:36.886235 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-787be6ec-e420-4ac7-8558-25154f4173d0 req-ed051b10-b29b-4878-92f4-5b7f4ac349e1 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059772 Nov 02 16:52:36.887156 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 452/878] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:52:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:52:37.472649 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cb057372-4700-4004-b6da-44b8f3a31f39 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:37.475030 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-cb057372-4700-4004-b6da-44b8f3a31f39 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:37.484744 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cb057372-4700-4004-b6da-44b8f3a31f39 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:37.486015 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cb057372-4700-4004-b6da-44b8f3a31f39 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:37.487325 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cb057372-4700-4004-b6da-44b8f3a31f39 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:37.490148 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cb057372-4700-4004-b6da-44b8f3a31f39 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:37.827588 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e3193555-144a-41f4-bf16-fdfc9ff5eb35 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:37.828564 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e3193555-144a-41f4-bf16-fdfc9ff5eb35 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:37.841557 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-cb057372-4700-4004-b6da-44b8f3a31f39 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:37.844959 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e3193555-144a-41f4-bf16-fdfc9ff5eb35 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:37.845785 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e3193555-144a-41f4-bf16-fdfc9ff5eb35 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:37.847117 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e3193555-144a-41f4-bf16-fdfc9ff5eb35 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:37.849477 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e3193555-144a-41f4-bf16-fdfc9ff5eb35 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:37.853319 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-cb057372-4700-4004-b6da-44b8f3a31f39 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:37.859532 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-cb057372-4700-4004-b6da-44b8f3a31f39 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:37.861891 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-cb057372-4700-4004-b6da-44b8f3a31f39 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1409 microversion: 2.20 time: 0.396365 Nov 02 16:52:37.863576 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 427/879] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:37 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:38.099671 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-cb0f6ad4-d34d-4745-9651-285edc7f8149 req-fb06337b-3f63-432a-9fd9-1a9b3e47e7ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "886e9a36-a4f8-44ed-80d0-6a440f49e430", "tag": "a1262248-0dda-4533-af48-5c1338bb2d4c"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:38.101604 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:52:38.101604 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:52:38.113513 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-cb0f6ad4-d34d-4745-9651-285edc7f8149 req-fb06337b-3f63-432a-9fd9-1a9b3e47e7ef service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:38.114004 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-cb0f6ad4-d34d-4745-9651-285edc7f8149 req-fb06337b-3f63-432a-9fd9-1a9b3e47e7ef service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:38.131132 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-cb0f6ad4-d34d-4745-9651-285edc7f8149 req-fb06337b-3f63-432a-9fd9-1a9b3e47e7ef service nova] Creating event network-changed:a1262248-0dda-4533-af48-5c1338bb2d4c for instance 886e9a36-a4f8-44ed-80d0-6a440f49e430 on hv-cinder-77387 Nov 02 16:52:38.138105 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-cb0f6ad4-d34d-4745-9651-285edc7f8149 req-fb06337b-3f63-432a-9fd9-1a9b3e47e7ef service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043295 Nov 02 16:52:38.139564 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 428/880] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:52:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:52:38.371439 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e3193555-144a-41f4-bf16-fdfc9ff5eb35 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:38.389511 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e3193555-144a-41f4-bf16-fdfc9ff5eb35 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1266 microversion: 2.1 time: 0.567657 Nov 02 16:52:38.390707 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 453/881] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:37 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1266 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:38.896198 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c61d0639-545d-4116-8f9e-ec97dc5854aa tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:38.897067 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c61d0639-545d-4116-8f9e-ec97dc5854aa tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:38.909881 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c61d0639-545d-4116-8f9e-ec97dc5854aa tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:38.910503 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c61d0639-545d-4116-8f9e-ec97dc5854aa tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:38.911433 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c61d0639-545d-4116-8f9e-ec97dc5854aa tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:38.911968 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c61d0639-545d-4116-8f9e-ec97dc5854aa tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:39.407708 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c6448bda-ec27-4be8-9254-21ad7916ffcc tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:39.408657 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c6448bda-ec27-4be8-9254-21ad7916ffcc tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:39.415817 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c6448bda-ec27-4be8-9254-21ad7916ffcc tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:39.416358 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c6448bda-ec27-4be8-9254-21ad7916ffcc tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:39.417267 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c6448bda-ec27-4be8-9254-21ad7916ffcc tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:39.417717 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c6448bda-ec27-4be8-9254-21ad7916ffcc tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:39.579713 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c6448bda-ec27-4be8-9254-21ad7916ffcc tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:39.589366 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c6448bda-ec27-4be8-9254-21ad7916ffcc tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1266 microversion: 2.1 time: 0.185820 Nov 02 16:52:39.590164 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 454/882] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:39 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:39.643061 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-c61d0639-545d-4116-8f9e-ec97dc5854aa tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:39.655424 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-c61d0639-545d-4116-8f9e-ec97dc5854aa tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:39.657997 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-c61d0639-545d-4116-8f9e-ec97dc5854aa tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:39.662359 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c61d0639-545d-4116-8f9e-ec97dc5854aa tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1409 microversion: 2.20 time: 0.770104 Nov 02 16:52:39.676361 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 429/883] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:38 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1409 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:40.372007 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bcebd3d1-b48d-4966-ae0c-e96830e57a2c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:40.373189 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-bcebd3d1-b48d-4966-ae0c-e96830e57a2c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:40.380461 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bcebd3d1-b48d-4966-ae0c-e96830e57a2c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:40.381058 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bcebd3d1-b48d-4966-ae0c-e96830e57a2c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:40.381989 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bcebd3d1-b48d-4966-ae0c-e96830e57a2c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:40.382525 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bcebd3d1-b48d-4966-ae0c-e96830e57a2c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:40.420798 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-bcebd3d1-b48d-4966-ae0c-e96830e57a2c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053907 Nov 02 16:52:40.422021 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 455/884] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:52:40 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:52:40.488758 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2541a63f-af39-4f0b-8e2e-05ba32dfb192 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:40.489599 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2541a63f-af39-4f0b-8e2e-05ba32dfb192 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:40.497483 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2541a63f-af39-4f0b-8e2e-05ba32dfb192 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:40.497951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2541a63f-af39-4f0b-8e2e-05ba32dfb192 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:40.498783 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2541a63f-af39-4f0b-8e2e-05ba32dfb192 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:40.499231 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2541a63f-af39-4f0b-8e2e-05ba32dfb192 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:40.529299 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2541a63f-af39-4f0b-8e2e-05ba32dfb192 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Going to try to terminate instance {{(pid=127648) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:52:40.610440 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-098cc06e-a257-4ac1-b13c-fa9c20327e0f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:40.612659 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-098cc06e-a257-4ac1-b13c-fa9c20327e0f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:40.620508 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2541a63f-af39-4f0b-8e2e-05ba32dfb192 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "DELETE /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 204 len: 0 microversion: 2.1 time: 0.135542 Nov 02 16:52:40.621781 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 430/885] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:52:40 2021] DELETE /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:52:40.622591 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-098cc06e-a257-4ac1-b13c-fa9c20327e0f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:40.623369 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-098cc06e-a257-4ac1-b13c-fa9c20327e0f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:40.624752 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-098cc06e-a257-4ac1-b13c-fa9c20327e0f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:40.625484 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-098cc06e-a257-4ac1-b13c-fa9c20327e0f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:40.634638 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2e5310f8-87ab-451b-af21-1727cd3b7048 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:40.635845 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2e5310f8-87ab-451b-af21-1727cd3b7048 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:40.643467 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2e5310f8-87ab-451b-af21-1727cd3b7048 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:40.644489 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2e5310f8-87ab-451b-af21-1727cd3b7048 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:40.645563 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2e5310f8-87ab-451b-af21-1727cd3b7048 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:40.646201 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2e5310f8-87ab-451b-af21-1727cd3b7048 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:40.827494 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2e5310f8-87ab-451b-af21-1727cd3b7048 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:40.844852 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2e5310f8-87ab-451b-af21-1727cd3b7048 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1677 microversion: 2.1 time: 0.217402 Nov 02 16:52:40.846081 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 431/886] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:40 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:40.855744 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2c307f51-e8cb-4231-a3bb-98c02b3a2a02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:40.856974 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2c307f51-e8cb-4231-a3bb-98c02b3a2a02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:40.868226 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2c307f51-e8cb-4231-a3bb-98c02b3a2a02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:40.868979 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2c307f51-e8cb-4231-a3bb-98c02b3a2a02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:40.869931 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2c307f51-e8cb-4231-a3bb-98c02b3a2a02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:40.870383 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2c307f51-e8cb-4231-a3bb-98c02b3a2a02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:40.921464 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-098cc06e-a257-4ac1-b13c-fa9c20327e0f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:40.937449 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-098cc06e-a257-4ac1-b13c-fa9c20327e0f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1266 microversion: 2.1 time: 0.331918 Nov 02 16:52:40.938281 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 456/887] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:40 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:52:41.066862 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2c307f51-e8cb-4231-a3bb-98c02b3a2a02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:41.078255 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2c307f51-e8cb-4231-a3bb-98c02b3a2a02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:41.079986 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2c307f51-e8cb-4231-a3bb-98c02b3a2a02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:41.081358 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2c307f51-e8cb-4231-a3bb-98c02b3a2a02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1409 microversion: 2.20 time: 0.233590 Nov 02 16:52:41.082429 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 432/888] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:40 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1409 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:41.879889 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f992768d-b1d1-413b-88b4-587979e9a90b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:41.882331 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f992768d-b1d1-413b-88b4-587979e9a90b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:41.892820 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f992768d-b1d1-413b-88b4-587979e9a90b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:41.893718 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f992768d-b1d1-413b-88b4-587979e9a90b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:41.894774 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f992768d-b1d1-413b-88b4-587979e9a90b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:41.895501 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f992768d-b1d1-413b-88b4-587979e9a90b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:41.961390 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-bd2721aa-a8ef-4f87-b515-153c8a4b126e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:41.966117 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-bd2721aa-a8ef-4f87-b515-153c8a4b126e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:41.983952 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bd2721aa-a8ef-4f87-b515-153c8a4b126e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:41.985337 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bd2721aa-a8ef-4f87-b515-153c8a4b126e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:41.986790 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bd2721aa-a8ef-4f87-b515-153c8a4b126e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:41.987721 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bd2721aa-a8ef-4f87-b515-153c8a4b126e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:42.129544 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f992768d-b1d1-413b-88b4-587979e9a90b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:42.142809 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f992768d-b1d1-413b-88b4-587979e9a90b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1677 microversion: 2.1 time: 0.273135 Nov 02 16:52:42.143940 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 457/889] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:41 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1677 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:42.149065 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f92163f2-c729-4082-a617-a79fc366399d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:42.151003 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f92163f2-c729-4082-a617-a79fc366399d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:42.158603 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f92163f2-c729-4082-a617-a79fc366399d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:42.159417 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f92163f2-c729-4082-a617-a79fc366399d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:42.160538 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f92163f2-c729-4082-a617-a79fc366399d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:42.161207 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f92163f2-c729-4082-a617-a79fc366399d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:42.348579 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f92163f2-c729-4082-a617-a79fc366399d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:42.359711 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f92163f2-c729-4082-a617-a79fc366399d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:42.361466 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f92163f2-c729-4082-a617-a79fc366399d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:42.362749 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f92163f2-c729-4082-a617-a79fc366399d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1409 microversion: 2.20 time: 0.217684 Nov 02 16:52:42.363838 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 458/890] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:42 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1409 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:42.404465 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-bd2721aa-a8ef-4f87-b515-153c8a4b126e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:42.414542 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-bd2721aa-a8ef-4f87-b515-153c8a4b126e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1266 microversion: 2.1 time: 0.460719 Nov 02 16:52:42.422804 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 433/891] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:41 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1266 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:43.173441 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-051238d9-1155-4b96-a304-027a3505b37b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:43.174684 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-051238d9-1155-4b96-a304-027a3505b37b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:43.189749 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-051238d9-1155-4b96-a304-027a3505b37b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:43.190891 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-051238d9-1155-4b96-a304-027a3505b37b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:43.192509 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-051238d9-1155-4b96-a304-027a3505b37b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:43.193220 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-051238d9-1155-4b96-a304-027a3505b37b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:43.307097 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-051238d9-1155-4b96-a304-027a3505b37b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:43.320968 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-051238d9-1155-4b96-a304-027a3505b37b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1610 microversion: 2.1 time: 0.152455 Nov 02 16:52:43.333059 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 459/892] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:43 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1610 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:43.382222 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e4e66534-aa40-4229-8dcc-f2d8e10912ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:43.382948 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e4e66534-aa40-4229-8dcc-f2d8e10912ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:43.390393 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4e66534-aa40-4229-8dcc-f2d8e10912ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:43.390859 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4e66534-aa40-4229-8dcc-f2d8e10912ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:43.391800 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4e66534-aa40-4229-8dcc-f2d8e10912ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:43.392356 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4e66534-aa40-4229-8dcc-f2d8e10912ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:43.436168 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-61f4a394-ef59-41cf-a086-a28d0e6edc60 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:43.436840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-61f4a394-ef59-41cf-a086-a28d0e6edc60 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:43.466478 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-61f4a394-ef59-41cf-a086-a28d0e6edc60 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:43.468698 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-61f4a394-ef59-41cf-a086-a28d0e6edc60 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:43.469592 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-61f4a394-ef59-41cf-a086-a28d0e6edc60 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:43.471386 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-61f4a394-ef59-41cf-a086-a28d0e6edc60 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:43.763747 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-61f4a394-ef59-41cf-a086-a28d0e6edc60 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:43.778978 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-61f4a394-ef59-41cf-a086-a28d0e6edc60 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1266 microversion: 2.1 time: 0.347312 Nov 02 16:52:43.780147 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 460/893] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:43 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:52:43.828589 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e4e66534-aa40-4229-8dcc-f2d8e10912ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:43.853422 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e4e66534-aa40-4229-8dcc-f2d8e10912ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:43.856587 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e4e66534-aa40-4229-8dcc-f2d8e10912ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:43.857861 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e4e66534-aa40-4229-8dcc-f2d8e10912ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1409 microversion: 2.20 time: 0.479823 Nov 02 16:52:43.871940 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 434/894] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:43 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1409 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:43.904854 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-8889e9fd-1863-4e7c-aeca-b38ddd81897d req-18bf7420-6108-40cc-9058-1eed106d6657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0809e6-a338-4bc7-8413-86af16333eb4", "name": "network-vif-deleted", "tag": "8f7b9d28-8f61-494a-88cb-4fc30ad64a7e"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:43.907012 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:52:43.907012 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:52:43.939732 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-8889e9fd-1863-4e7c-aeca-b38ddd81897d req-18bf7420-6108-40cc-9058-1eed106d6657 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:43.946463 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-8889e9fd-1863-4e7c-aeca-b38ddd81897d req-18bf7420-6108-40cc-9058-1eed106d6657 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:43.966568 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-8889e9fd-1863-4e7c-aeca-b38ddd81897d req-18bf7420-6108-40cc-9058-1eed106d6657 service nova] Creating event network-vif-deleted:8f7b9d28-8f61-494a-88cb-4fc30ad64a7e for instance 1e0809e6-a338-4bc7-8413-86af16333eb4 on hv-cinder-77387 Nov 02 16:52:43.982699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-8889e9fd-1863-4e7c-aeca-b38ddd81897d req-18bf7420-6108-40cc-9058-1eed106d6657 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083114 Nov 02 16:52:43.984470 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 435/895] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:52:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:52:44.075266 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-3ce613e5-1a6a-4f69-a063-2ba38ac1719f req-da2b8714-66f7-4912-893d-d1dc55fce1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886e9a36-a4f8-44ed-80d0-6a440f49e430", "name": "network-vif-plugged", "status": "completed", "tag": "a1262248-0dda-4533-af48-5c1338bb2d4c"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:44.077158 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:52:44.077158 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:52:44.086104 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-3ce613e5-1a6a-4f69-a063-2ba38ac1719f req-da2b8714-66f7-4912-893d-d1dc55fce1e5 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:44.086618 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-3ce613e5-1a6a-4f69-a063-2ba38ac1719f req-da2b8714-66f7-4912-893d-d1dc55fce1e5 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:44.105393 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-3ce613e5-1a6a-4f69-a063-2ba38ac1719f req-da2b8714-66f7-4912-893d-d1dc55fce1e5 service nova] Creating event network-vif-plugged:a1262248-0dda-4533-af48-5c1338bb2d4c for instance 886e9a36-a4f8-44ed-80d0-6a440f49e430 on hv-cinder-77387 Nov 02 16:52:44.112904 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-3ce613e5-1a6a-4f69-a063-2ba38ac1719f req-da2b8714-66f7-4912-893d-d1dc55fce1e5 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.307111 Nov 02 16:52:44.114099 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 461/896] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:52:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:52:44.352099 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b2c2ba1a-fbb9-49cd-8799-817f125ba51e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:44.353299 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b2c2ba1a-fbb9-49cd-8799-817f125ba51e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:44.362999 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2c2ba1a-fbb9-49cd-8799-817f125ba51e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:44.364156 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2c2ba1a-fbb9-49cd-8799-817f125ba51e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:44.365400 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2c2ba1a-fbb9-49cd-8799-817f125ba51e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:44.366257 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2c2ba1a-fbb9-49cd-8799-817f125ba51e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:44.433763 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2c2ba1a-fbb9-49cd-8799-817f125ba51e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:44.435833 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2c2ba1a-fbb9-49cd-8799-817f125ba51e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:44.438306 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.objects.instance [None req-b2c2ba1a-fbb9-49cd-8799-817f125ba51e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lazy-loading 'fault' on Instance uuid 1e0809e6-a338-4bc7-8413-86af16333eb4 {{(pid=127648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:52:44.533877 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b2c2ba1a-fbb9-49cd-8799-817f125ba51e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:44.543894 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b2c2ba1a-fbb9-49cd-8799-817f125ba51e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 200 len: 1330 microversion: 2.1 time: 0.197786 Nov 02 16:52:44.544816 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 436/897] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:44 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 1330 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:52:44.800574 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-92881b9b-86dc-4c80-8e98-3d04acd3f1ec tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:44.801465 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-92881b9b-86dc-4c80-8e98-3d04acd3f1ec tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:44.817998 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-92881b9b-86dc-4c80-8e98-3d04acd3f1ec tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:44.819072 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-92881b9b-86dc-4c80-8e98-3d04acd3f1ec tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:44.820059 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-92881b9b-86dc-4c80-8e98-3d04acd3f1ec tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:44.820698 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-92881b9b-86dc-4c80-8e98-3d04acd3f1ec tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:44.877307 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-20eda801-c63a-4de9-917e-ac9fe19d9019 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:44.880115 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-20eda801-c63a-4de9-917e-ac9fe19d9019 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:44.892756 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-20eda801-c63a-4de9-917e-ac9fe19d9019 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:44.893436 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-20eda801-c63a-4de9-917e-ac9fe19d9019 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:44.894439 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-20eda801-c63a-4de9-917e-ac9fe19d9019 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:44.895055 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-20eda801-c63a-4de9-917e-ac9fe19d9019 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:45.044384 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-92881b9b-86dc-4c80-8e98-3d04acd3f1ec tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:45.055356 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-92881b9b-86dc-4c80-8e98-3d04acd3f1ec tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1266 microversion: 2.1 time: 0.260731 Nov 02 16:52:45.056726 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 462/898] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:44 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:45.130548 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-20eda801-c63a-4de9-917e-ac9fe19d9019 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:45.140287 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-20eda801-c63a-4de9-917e-ac9fe19d9019 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:45.141878 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-20eda801-c63a-4de9-917e-ac9fe19d9019 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:45.143085 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-20eda801-c63a-4de9-917e-ac9fe19d9019 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1409 microversion: 2.20 time: 0.271120 Nov 02 16:52:45.144131 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 437/899] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:44 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1409 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:45.565825 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4291dd1b-607a-4c20-ab89-6120b0f76b0c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:45.567126 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4291dd1b-607a-4c20-ab89-6120b0f76b0c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:45.577969 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4291dd1b-607a-4c20-ab89-6120b0f76b0c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:45.579113 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4291dd1b-607a-4c20-ab89-6120b0f76b0c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:45.581404 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4291dd1b-607a-4c20-ab89-6120b0f76b0c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:45.582549 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4291dd1b-607a-4c20-ab89-6120b0f76b0c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:45.603976 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-4291dd1b-607a-4c20-ab89-6120b0f76b0c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] HTTP exception thrown: Instance 1e0809e6-a338-4bc7-8413-86af16333eb4 could not be found. Nov 02 16:52:45.605070 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4291dd1b-607a-4c20-ab89-6120b0f76b0c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Returning 404 to user: Instance 1e0809e6-a338-4bc7-8413-86af16333eb4 could not be found. {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:52:45.609395 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4291dd1b-607a-4c20-ab89-6120b0f76b0c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 404 len: 111 microversion: 2.1 time: 0.049300 Nov 02 16:52:45.611093 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 463/900] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:45 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:52:45.622991 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-eb2f03e1-4ed6-49a2-9bbe-a9b867501806 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '.version_select at 0x7f112ec838b0>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:45.672040 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-eb2f03e1-4ed6-49a2-9bbe-a9b867501806 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875712050" status: 202 len: 0 microversion: 2.1 time: 0.053370 Nov 02 16:52:45.673381 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 438/901] 10.222.0.118 () {58 vars in 1225 bytes} [Tue Nov 2 16:52:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875712050 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:52:46.076010 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-02ee42cd-161d-41b1-aa17-55fc9092bc49 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:46.078982 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-02ee42cd-161d-41b1-aa17-55fc9092bc49 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:46.086101 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-02ee42cd-161d-41b1-aa17-55fc9092bc49 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:46.087651 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-02ee42cd-161d-41b1-aa17-55fc9092bc49 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:46.088781 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-02ee42cd-161d-41b1-aa17-55fc9092bc49 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:46.089488 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-02ee42cd-161d-41b1-aa17-55fc9092bc49 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:46.162573 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4fdc57d6-3dba-4bd2-a9af-e755ac5ec0ef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:46.163253 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4fdc57d6-3dba-4bd2-a9af-e755ac5ec0ef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:46.171306 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4fdc57d6-3dba-4bd2-a9af-e755ac5ec0ef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:46.171777 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4fdc57d6-3dba-4bd2-a9af-e755ac5ec0ef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:46.172956 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4fdc57d6-3dba-4bd2-a9af-e755ac5ec0ef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:46.173342 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4fdc57d6-3dba-4bd2-a9af-e755ac5ec0ef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:46.306916 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-02ee42cd-161d-41b1-aa17-55fc9092bc49 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:46.316494 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-02ee42cd-161d-41b1-aa17-55fc9092bc49 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1266 microversion: 2.1 time: 0.247179 Nov 02 16:52:46.317958 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 464/902] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:46 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:46.463932 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4fdc57d6-3dba-4bd2-a9af-e755ac5ec0ef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:46.479576 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4fdc57d6-3dba-4bd2-a9af-e755ac5ec0ef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:46.481207 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4fdc57d6-3dba-4bd2-a9af-e755ac5ec0ef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:46.484120 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4fdc57d6-3dba-4bd2-a9af-e755ac5ec0ef tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1602 microversion: 2.20 time: 0.324384 Nov 02 16:52:46.487970 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 439/903] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:52:46 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1602 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:52:46.507026 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-77852949-da77-4e57-aba6-62e5fb897963 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:46.507533 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-77852949-da77-4e57-aba6-62e5fb897963 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:46.517914 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77852949-da77-4e57-aba6-62e5fb897963 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:46.518394 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77852949-da77-4e57-aba6-62e5fb897963 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:46.519237 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77852949-da77-4e57-aba6-62e5fb897963 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:46.519687 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77852949-da77-4e57-aba6-62e5fb897963 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:46.631107 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-77852949-da77-4e57-aba6-62e5fb897963 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.128780 Nov 02 16:52:46.632151 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 465/904] 10.222.0.118 () {60 vars in 1320 bytes} [Tue Nov 2 16:52:46 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:52:47.079511 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-fcfb91c3-3f1c-4df5-b66b-a927fd3ba722 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'create', calling method: .version_select at 0x7f112ed7e9d0>, body: {"keypair": {"name": "tempest-keypair-251418689"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:47.106616 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-fcfb91c3-3f1c-4df5-b66b-a927fd3ba722 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Getting quotas for project a575c6bd2e574ad19dc299cc1df253f3. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:52:47.111404 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-fcfb91c3-3f1c-4df5-b66b-a927fd3ba722 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Getting quotas for user 821a58487d5b4087bac538d532382aef and project a575c6bd2e574ad19dc299cc1df253f3. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:52:47.337115 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-73469940-116a-4a64-a0bc-5dfb77192bcb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:47.338748 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-73469940-116a-4a64-a0bc-5dfb77192bcb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:47.346158 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-73469940-116a-4a64-a0bc-5dfb77192bcb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:47.347038 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-73469940-116a-4a64-a0bc-5dfb77192bcb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:47.348102 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-73469940-116a-4a64-a0bc-5dfb77192bcb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:47.348791 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-73469940-116a-4a64-a0bc-5dfb77192bcb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:47.359395 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-fcfb91c3-3f1c-4df5-b66b-a927fd3ba722 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Getting quotas for project a575c6bd2e574ad19dc299cc1df253f3. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:52:47.364904 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-fcfb91c3-3f1c-4df5-b66b-a927fd3ba722 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Getting quotas for user 821a58487d5b4087bac538d532382aef and project a575c6bd2e574ad19dc299cc1df253f3. Resources: {'key_pairs'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:52:47.386109 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-fcfb91c3-3f1c-4df5-b66b-a927fd3ba722 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.313765 Nov 02 16:52:47.387604 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 440/905] 10.222.0.118 () {60 vars in 1162 bytes} [Tue Nov 2 16:52:47 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:47.671529 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-73469940-116a-4a64-a0bc-5dfb77192bcb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:47.687318 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-b689ab9b-a3c9-4f0f-b5ac-98d10a59a8ba req-1631a69e-76c4-4211-b077-97b7ce3ed8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc9451a-ff42-4d58-8086-84efeda40e0b", "name": "network-vif-plugged", "status": "completed", "tag": "38f4c5ac-fd67-4d6a-bcb0-06b8456ad406"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:47.689374 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:52:47.689374 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:52:47.699235 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-73469940-116a-4a64-a0bc-5dfb77192bcb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1266 microversion: 2.1 time: 0.367861 Nov 02 16:52:47.700231 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 466/906] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:47 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1266 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:47.718645 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-b689ab9b-a3c9-4f0f-b5ac-98d10a59a8ba req-1631a69e-76c4-4211-b077-97b7ce3ed8b6 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:47.720882 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-b689ab9b-a3c9-4f0f-b5ac-98d10a59a8ba req-1631a69e-76c4-4211-b077-97b7ce3ed8b6 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:47.754596 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-b689ab9b-a3c9-4f0f-b5ac-98d10a59a8ba req-1631a69e-76c4-4211-b077-97b7ce3ed8b6 service nova] Creating event network-vif-plugged:38f4c5ac-fd67-4d6a-bcb0-06b8456ad406 for instance 0cc9451a-ff42-4d58-8086-84efeda40e0b on hv-cinder-77387 Nov 02 16:52:47.767373 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-b689ab9b-a3c9-4f0f-b5ac-98d10a59a8ba req-1631a69e-76c4-4211-b077-97b7ce3ed8b6 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087124 Nov 02 16:52:47.769985 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 441/907] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:52:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:52:48.213522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9ea58581-0b34-4428-8e56-849502372eed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:48.215639 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9ea58581-0b34-4428-8e56-849502372eed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:48.226793 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9ea58581-0b34-4428-8e56-849502372eed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:48.228309 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9ea58581-0b34-4428-8e56-849502372eed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:48.230418 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9ea58581-0b34-4428-8e56-849502372eed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:48.231452 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9ea58581-0b34-4428-8e56-849502372eed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:48.259278 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-a9fab0b6-0807-40d4-8fe1-275076d958fb req-235c66d3-c63e-43c6-873d-d309de0be7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "886e9a36-a4f8-44ed-80d0-6a440f49e430", "tag": "a1262248-0dda-4533-af48-5c1338bb2d4c"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:48.267424 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:52:48.267424 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:52:48.281436 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-a9fab0b6-0807-40d4-8fe1-275076d958fb req-235c66d3-c63e-43c6-873d-d309de0be7b0 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:48.282445 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-a9fab0b6-0807-40d4-8fe1-275076d958fb req-235c66d3-c63e-43c6-873d-d309de0be7b0 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:48.299100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-a9fab0b6-0807-40d4-8fe1-275076d958fb req-235c66d3-c63e-43c6-873d-d309de0be7b0 service nova] Creating event network-changed:a1262248-0dda-4533-af48-5c1338bb2d4c for instance 886e9a36-a4f8-44ed-80d0-6a440f49e430 on hv-cinder-77387 Nov 02 16:52:48.305671 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-a9fab0b6-0807-40d4-8fe1-275076d958fb req-235c66d3-c63e-43c6-873d-d309de0be7b0 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056539 Nov 02 16:52:48.306545 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 442/908] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:52:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:52:48.462809 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9ea58581-0b34-4428-8e56-849502372eed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 14 microversion: 2.20 time: 0.255587 Nov 02 16:52:48.468795 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 467/909] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:52:48 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 14 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:48.719432 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9a9e4b23-913b-41f2-87f0-a80f3480b98f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:48.720203 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9a9e4b23-913b-41f2-87f0-a80f3480b98f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:48.729700 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9a9e4b23-913b-41f2-87f0-a80f3480b98f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:48.730633 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9a9e4b23-913b-41f2-87f0-a80f3480b98f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:48.732126 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9a9e4b23-913b-41f2-87f0-a80f3480b98f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:48.733099 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9a9e4b23-913b-41f2-87f0-a80f3480b98f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:49.323792 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9a9e4b23-913b-41f2-87f0-a80f3480b98f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:49.353344 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9a9e4b23-913b-41f2-87f0-a80f3480b98f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1266 microversion: 2.1 time: 0.638511 Nov 02 16:52:49.364595 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 443/910] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:48 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1266 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:49.477200 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-27a66e1f-f59a-4c01-9ce9-eb39738bed02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:49.480884 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-27a66e1f-f59a-4c01-9ce9-eb39738bed02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:49.491602 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-27a66e1f-f59a-4c01-9ce9-eb39738bed02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:49.493985 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-27a66e1f-f59a-4c01-9ce9-eb39738bed02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:49.495591 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-27a66e1f-f59a-4c01-9ce9-eb39738bed02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:49.496447 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-27a66e1f-f59a-4c01-9ce9-eb39738bed02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:49.575810 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-27a66e1f-f59a-4c01-9ce9-eb39738bed02 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 14 microversion: 2.20 time: 0.103219 Nov 02 16:52:49.576674 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 468/911] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:52:49 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:50.383147 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0ee17aa8-d54d-4758-8033-f3f924d120b4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:50.386680 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0ee17aa8-d54d-4758-8033-f3f924d120b4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:50.412581 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0ee17aa8-d54d-4758-8033-f3f924d120b4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:50.413116 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0ee17aa8-d54d-4758-8033-f3f924d120b4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:50.414013 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0ee17aa8-d54d-4758-8033-f3f924d120b4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:50.414477 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0ee17aa8-d54d-4758-8033-f3f924d120b4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:50.607269 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-cf2e8b9d-10f4-46aa-9cbe-4b97653d264b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:50.612781 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-cf2e8b9d-10f4-46aa-9cbe-4b97653d264b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:50.624256 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cf2e8b9d-10f4-46aa-9cbe-4b97653d264b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:50.640207 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cf2e8b9d-10f4-46aa-9cbe-4b97653d264b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:50.641764 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cf2e8b9d-10f4-46aa-9cbe-4b97653d264b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:50.642945 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cf2e8b9d-10f4-46aa-9cbe-4b97653d264b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:50.747966 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-cf2e8b9d-10f4-46aa-9cbe-4b97653d264b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 14 microversion: 2.20 time: 0.162549 Nov 02 16:52:50.749168 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 469/912] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:52:50 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:50.881195 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-307414474", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3ac4ab4-0ce0-4abb-9960-272f99ead558"}], "security_groups": [{"name": "tempest-securitygroup--1101166698"}], "key_name": "tempest-keypair-251418689", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:50.901312 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0ee17aa8-d54d-4758-8033-f3f924d120b4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:50.917349 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0ee17aa8-d54d-4758-8033-f3f924d120b4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1453 microversion: 2.1 time: 0.547875 Nov 02 16:52:50.929497 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 444/913] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:50 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1453 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:50.936610 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-fd6094ae-7204-4393-b9d8-99ef58b7b622 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:50.938899 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-fd6094ae-7204-4393-b9d8-99ef58b7b622 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:50.947244 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fd6094ae-7204-4393-b9d8-99ef58b7b622 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:50.948245 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fd6094ae-7204-4393-b9d8-99ef58b7b622 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:50.949389 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fd6094ae-7204-4393-b9d8-99ef58b7b622 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:50.950105 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fd6094ae-7204-4393-b9d8-99ef58b7b622 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:51.088700 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.network.neutron [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] validate_networks() for [('c3ac4ab4-0ce0-4abb-9960-272f99ead558', None, None, None, None, None)] {{(pid=127649) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:52:51.263626 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-fd6094ae-7204-4393-b9d8-99ef58b7b622 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:51.276779 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-fd6094ae-7204-4393-b9d8-99ef58b7b622 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1453 microversion: 2.1 time: 0.344801 Nov 02 16:52:51.278749 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 445/914] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:50 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1453 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:51.761445 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d1e0a557-1f74-4316-acaa-600c4288c13b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:51.764110 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d1e0a557-1f74-4316-acaa-600c4288c13b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:51.774295 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d1e0a557-1f74-4316-acaa-600c4288c13b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:51.775443 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d1e0a557-1f74-4316-acaa-600c4288c13b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:51.776717 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d1e0a557-1f74-4316-acaa-600c4288c13b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:51.778199 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d1e0a557-1f74-4316-acaa-600c4288c13b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:51.869427 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d1e0a557-1f74-4316-acaa-600c4288c13b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 14 microversion: 2.20 time: 0.113606 Nov 02 16:52:51.872251 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 446/915] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:52:51 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:52:52.060373 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Flavor limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:52:52.063062 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Image limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:52:52.064621 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Flavor pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:52:52.065335 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Image pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:52:52.066247 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:52:52.089174 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:52.089764 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:52.091210 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:52.091904 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:52.136090 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Getting quotas for project a575c6bd2e574ad19dc299cc1df253f3. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:52:52.143624 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Getting quotas for user 821a58487d5b4087bac538d532382aef and project a575c6bd2e574ad19dc299cc1df253f3. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:52:52.158631 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Going to run 1 instances... {{(pid=127649) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:52:52.162664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:52:52.249780 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-d62fe5b8-95e1-4afa-b7b8-586ceae90c9f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.372872 Nov 02 16:52:52.256890 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 470/916] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:52:50 2021] POST /compute/v2.1/servers => generated 404 bytes in 1382 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 16:52:52.263698 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-14c30593-604c-459f-8447-b0bc58a1f9b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:52.264664 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-14c30593-604c-459f-8447-b0bc58a1f9b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:52.436045 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-14c30593-604c-459f-8447-b0bc58a1f9b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:52.444413 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-14c30593-604c-459f-8447-b0bc58a1f9b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1240 microversion: 2.1 time: 0.186319 Nov 02 16:52:52.455336 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 447/917] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:52 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1240 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:52:52.887398 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5ed951ee-6289-4219-9677-95444c049991 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:52.890816 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5ed951ee-6289-4219-9677-95444c049991 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:52.909874 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ed951ee-6289-4219-9677-95444c049991 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:52.911611 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ed951ee-6289-4219-9677-95444c049991 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:52.913913 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ed951ee-6289-4219-9677-95444c049991 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:52.915748 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5ed951ee-6289-4219-9677-95444c049991 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:53.022596 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5ed951ee-6289-4219-9677-95444c049991 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 14 microversion: 2.20 time: 0.143669 Nov 02 16:52:53.023735 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 471/918] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:52:52 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:53.468810 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-64f2d3df-41e8-4a1e-b310-27311f44d035 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:53.471839 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-64f2d3df-41e8-4a1e-b310-27311f44d035 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:53.484346 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-64f2d3df-41e8-4a1e-b310-27311f44d035 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:53.486408 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-64f2d3df-41e8-4a1e-b310-27311f44d035 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:53.488000 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-64f2d3df-41e8-4a1e-b310-27311f44d035 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:53.488739 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-64f2d3df-41e8-4a1e-b310-27311f44d035 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:53.643706 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-64f2d3df-41e8-4a1e-b310-27311f44d035 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:53.663314 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-64f2d3df-41e8-4a1e-b310-27311f44d035 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1292 microversion: 2.1 time: 0.204366 Nov 02 16:52:53.667784 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 448/919] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:53 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1292 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:54.036760 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c361d818-2cad-4929-ade0-8f6e511f0f2a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:54.037950 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c361d818-2cad-4929-ade0-8f6e511f0f2a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:54.056470 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c361d818-2cad-4929-ade0-8f6e511f0f2a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:54.057512 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c361d818-2cad-4929-ade0-8f6e511f0f2a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:54.059212 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c361d818-2cad-4929-ade0-8f6e511f0f2a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:54.059934 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c361d818-2cad-4929-ade0-8f6e511f0f2a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:54.145609 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c361d818-2cad-4929-ade0-8f6e511f0f2a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 14 microversion: 2.20 time: 0.113521 Nov 02 16:52:54.147250 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 472/920] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:52:54 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:54.507072 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-1ad0ba18-981f-4b6d-8694-15a913b18dcf req-ddf7318d-3ddd-4a88-849b-814414316c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc9451a-ff42-4d58-8086-84efeda40e0b", "tag": "38f4c5ac-fd67-4d6a-bcb0-06b8456ad406"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:54.509042 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:52:54.509042 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:52:54.524329 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-1ad0ba18-981f-4b6d-8694-15a913b18dcf req-ddf7318d-3ddd-4a88-849b-814414316c50 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:54.524828 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-1ad0ba18-981f-4b6d-8694-15a913b18dcf req-ddf7318d-3ddd-4a88-849b-814414316c50 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:54.548900 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-1ad0ba18-981f-4b6d-8694-15a913b18dcf req-ddf7318d-3ddd-4a88-849b-814414316c50 service nova] Creating event network-changed:38f4c5ac-fd67-4d6a-bcb0-06b8456ad406 for instance 0cc9451a-ff42-4d58-8086-84efeda40e0b on hv-cinder-77387 Nov 02 16:52:54.557079 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-1ad0ba18-981f-4b6d-8694-15a913b18dcf req-ddf7318d-3ddd-4a88-849b-814414316c50 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053470 Nov 02 16:52:54.563165 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 449/921] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:52:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:52:54.685609 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-43df2c5b-630b-40c4-ba23-0e6350187267 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:54.686334 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-43df2c5b-630b-40c4-ba23-0e6350187267 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:54.703770 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-43df2c5b-630b-40c4-ba23-0e6350187267 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:54.704276 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-43df2c5b-630b-40c4-ba23-0e6350187267 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:54.705129 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-43df2c5b-630b-40c4-ba23-0e6350187267 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:54.705578 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-43df2c5b-630b-40c4-ba23-0e6350187267 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:54.851421 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-43df2c5b-630b-40c4-ba23-0e6350187267 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:54.880533 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-43df2c5b-630b-40c4-ba23-0e6350187267 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1298 microversion: 2.1 time: 0.198730 Nov 02 16:52:54.881353 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 473/922] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:54 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1298 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:55.163367 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0bb105fc-ece4-43b0-a4b4-ecdf9dfbd0a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:55.166821 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0bb105fc-ece4-43b0-a4b4-ecdf9dfbd0a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:55.199161 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0bb105fc-ece4-43b0-a4b4-ecdf9dfbd0a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:55.200771 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0bb105fc-ece4-43b0-a4b4-ecdf9dfbd0a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:55.201987 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0bb105fc-ece4-43b0-a4b4-ecdf9dfbd0a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:55.203924 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0bb105fc-ece4-43b0-a4b4-ecdf9dfbd0a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:55.372273 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0bb105fc-ece4-43b0-a4b4-ecdf9dfbd0a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 14 microversion: 2.20 time: 0.215936 Nov 02 16:52:55.377697 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 450/923] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:52:55 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 14 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:55.901323 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e8e7aaec-8c8c-4ec7-9278-a7eb8c023f0d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:55.902109 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e8e7aaec-8c8c-4ec7-9278-a7eb8c023f0d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:55.921700 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e8e7aaec-8c8c-4ec7-9278-a7eb8c023f0d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:55.922388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e8e7aaec-8c8c-4ec7-9278-a7eb8c023f0d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:55.924712 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e8e7aaec-8c8c-4ec7-9278-a7eb8c023f0d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:55.929919 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e8e7aaec-8c8c-4ec7-9278-a7eb8c023f0d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:56.241064 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e8e7aaec-8c8c-4ec7-9278-a7eb8c023f0d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:56.255455 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e8e7aaec-8c8c-4ec7-9278-a7eb8c023f0d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1366 microversion: 2.1 time: 0.358674 Nov 02 16:52:56.256732 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 474/924] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:55 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:56.390324 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b3295134-a5ca-46bc-8d92-0b35fba43869 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:56.392980 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b3295134-a5ca-46bc-8d92-0b35fba43869 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:56.404059 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b3295134-a5ca-46bc-8d92-0b35fba43869 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:56.405304 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b3295134-a5ca-46bc-8d92-0b35fba43869 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:56.406439 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b3295134-a5ca-46bc-8d92-0b35fba43869 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:56.407137 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b3295134-a5ca-46bc-8d92-0b35fba43869 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:56.498236 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b3295134-a5ca-46bc-8d92-0b35fba43869 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 14 microversion: 2.20 time: 0.112482 Nov 02 16:52:56.501652 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 451/925] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:52:56 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:56.823639 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-1a14d316-cab0-41a4-837f-a2b465bc53b8 req-d704cf6a-50cf-44b9-9275-604a9fc61f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61572fbe-ccf7-4ed4-80ab-eda95f187229", "tag": "f902bd79-9248-4da6-847e-36b46e3fa1b9"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:56.826017 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:52:56.826017 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:52:56.836006 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-1a14d316-cab0-41a4-837f-a2b465bc53b8 req-d704cf6a-50cf-44b9-9275-604a9fc61f82 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:56.837692 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-1a14d316-cab0-41a4-837f-a2b465bc53b8 req-d704cf6a-50cf-44b9-9275-604a9fc61f82 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:56.855545 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-1a14d316-cab0-41a4-837f-a2b465bc53b8 req-d704cf6a-50cf-44b9-9275-604a9fc61f82 service nova] Creating event network-changed:f902bd79-9248-4da6-847e-36b46e3fa1b9 for instance 61572fbe-ccf7-4ed4-80ab-eda95f187229 on hv-cinder-77387 Nov 02 16:52:56.872047 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-1a14d316-cab0-41a4-837f-a2b465bc53b8 req-d704cf6a-50cf-44b9-9275-604a9fc61f82 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055329 Nov 02 16:52:56.874003 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 475/926] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:52:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:52:57.274784 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0afc8e2b-e821-4591-b5cb-9c1146b08a5d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:57.276081 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0afc8e2b-e821-4591-b5cb-9c1146b08a5d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:57.284229 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0afc8e2b-e821-4591-b5cb-9c1146b08a5d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:57.285204 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0afc8e2b-e821-4591-b5cb-9c1146b08a5d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:57.286310 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0afc8e2b-e821-4591-b5cb-9c1146b08a5d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:57.287034 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0afc8e2b-e821-4591-b5cb-9c1146b08a5d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:57.518133 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-65826335-db84-4b46-862a-45e1e4006cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:57.520510 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-65826335-db84-4b46-862a-45e1e4006cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:57.529784 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-65826335-db84-4b46-862a-45e1e4006cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:57.530253 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-65826335-db84-4b46-862a-45e1e4006cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:57.531328 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-65826335-db84-4b46-862a-45e1e4006cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:57.531973 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-65826335-db84-4b46-862a-45e1e4006cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:57.616012 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-65826335-db84-4b46-862a-45e1e4006cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 14 microversion: 2.20 time: 0.105804 Nov 02 16:52:57.620923 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 476/927] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:52:57 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:58.002279 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0afc8e2b-e821-4591-b5cb-9c1146b08a5d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:58.012470 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0afc8e2b-e821-4591-b5cb-9c1146b08a5d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1366 microversion: 2.1 time: 0.742303 Nov 02 16:52:58.013124 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 452/928] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:57 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1366 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:52:58.629223 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bb07fe08-e2cc-4572-86d4-61c260a04ad8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:52:58.631241 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-bb07fe08-e2cc-4572-86d4-61c260a04ad8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:58.648365 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bb07fe08-e2cc-4572-86d4-61c260a04ad8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:58.650370 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bb07fe08-e2cc-4572-86d4-61c260a04ad8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:58.651831 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bb07fe08-e2cc-4572-86d4-61c260a04ad8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:58.652619 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bb07fe08-e2cc-4572-86d4-61c260a04ad8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:59.032760 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-343e23e8-2002-4e20-a871-3648092742bc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:52:59.034334 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-343e23e8-2002-4e20-a871-3648092742bc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:52:59.044610 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-343e23e8-2002-4e20-a871-3648092742bc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:59.045588 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-343e23e8-2002-4e20-a871-3648092742bc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:59.046941 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-343e23e8-2002-4e20-a871-3648092742bc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:52:59.047638 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-343e23e8-2002-4e20-a871-3648092742bc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:52:59.134097 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-bb07fe08-e2cc-4572-86d4-61c260a04ad8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 3975 microversion: 2.20 time: 0.509424 Nov 02 16:52:59.135885 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 477/929] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:52:58 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 3975 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:52:59.297068 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-343e23e8-2002-4e20-a871-3648092742bc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:52:59.325542 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-343e23e8-2002-4e20-a871-3648092742bc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1366 microversion: 2.1 time: 0.297195 Nov 02 16:52:59.338146 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 453/930] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:52:59 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:00.148344 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-dfc5ba1d-4012-419d-a5bf-638a5b5a228c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:00.151275 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-dfc5ba1d-4012-419d-a5bf-638a5b5a228c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:00.159990 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dfc5ba1d-4012-419d-a5bf-638a5b5a228c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:00.160836 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dfc5ba1d-4012-419d-a5bf-638a5b5a228c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:00.162263 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dfc5ba1d-4012-419d-a5bf-638a5b5a228c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:00.162965 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dfc5ba1d-4012-419d-a5bf-638a5b5a228c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:00.268609 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-dfc5ba1d-4012-419d-a5bf-638a5b5a228c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 11535 microversion: 2.20 time: 0.123833 Nov 02 16:53:00.269635 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 478/931] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:00 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 11535 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:00.345112 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3ccea500-7db7-403d-8428-cadb8831a4fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:00.345866 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3ccea500-7db7-403d-8428-cadb8831a4fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:00.354715 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3ccea500-7db7-403d-8428-cadb8831a4fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:00.355390 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3ccea500-7db7-403d-8428-cadb8831a4fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:00.356378 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3ccea500-7db7-403d-8428-cadb8831a4fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:00.356939 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3ccea500-7db7-403d-8428-cadb8831a4fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:00.538685 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3ccea500-7db7-403d-8428-cadb8831a4fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:00.548208 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3ccea500-7db7-403d-8428-cadb8831a4fc tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1366 microversion: 2.1 time: 0.207699 Nov 02 16:53:00.548932 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 454/932] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:00 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:01.288910 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1c71370e-212a-4c9c-801e-ac8c9a35c754 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:01.293974 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1c71370e-212a-4c9c-801e-ac8c9a35c754 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:01.318819 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1c71370e-212a-4c9c-801e-ac8c9a35c754 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:01.322131 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1c71370e-212a-4c9c-801e-ac8c9a35c754 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:01.331272 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1c71370e-212a-4c9c-801e-ac8c9a35c754 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:01.332292 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1c71370e-212a-4c9c-801e-ac8c9a35c754 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:01.450340 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1c71370e-212a-4c9c-801e-ac8c9a35c754 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 17354 microversion: 2.20 time: 0.170679 Nov 02 16:53:01.456333 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 479/933] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:01 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 17354 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:01.567849 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d64f9882-3023-4acf-b810-7de2732918e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:01.569483 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d64f9882-3023-4acf-b810-7de2732918e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:01.578184 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d64f9882-3023-4acf-b810-7de2732918e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:01.579051 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d64f9882-3023-4acf-b810-7de2732918e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:01.579907 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d64f9882-3023-4acf-b810-7de2732918e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:01.580431 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d64f9882-3023-4acf-b810-7de2732918e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:01.879522 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d64f9882-3023-4acf-b810-7de2732918e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:01.889511 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d64f9882-3023-4acf-b810-7de2732918e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1366 microversion: 2.1 time: 0.325878 Nov 02 16:53:01.890325 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 455/934] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:01 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:02.478165 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1e933791-5a41-4102-b68f-345d6ac6dd5b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:02.484540 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1e933791-5a41-4102-b68f-345d6ac6dd5b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:02.500824 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1e933791-5a41-4102-b68f-345d6ac6dd5b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:02.502053 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1e933791-5a41-4102-b68f-345d6ac6dd5b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:02.503927 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1e933791-5a41-4102-b68f-345d6ac6dd5b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:02.505537 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1e933791-5a41-4102-b68f-345d6ac6dd5b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:02.613347 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1e933791-5a41-4102-b68f-345d6ac6dd5b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 18083 microversion: 2.20 time: 0.151890 Nov 02 16:53:02.614591 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 480/935] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:02 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 18083 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:02.910334 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-81520eb4-9175-432c-ab21-ff9c143a9a6d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:02.912135 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-81520eb4-9175-432c-ab21-ff9c143a9a6d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:02.922350 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-81520eb4-9175-432c-ab21-ff9c143a9a6d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:02.923619 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-81520eb4-9175-432c-ab21-ff9c143a9a6d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:02.925617 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-81520eb4-9175-432c-ab21-ff9c143a9a6d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:02.926477 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-81520eb4-9175-432c-ab21-ff9c143a9a6d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:03.204394 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-81520eb4-9175-432c-ab21-ff9c143a9a6d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:03.217397 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-81520eb4-9175-432c-ab21-ff9c143a9a6d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1366 microversion: 2.1 time: 0.311613 Nov 02 16:53:03.228691 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 456/936] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:02 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:03.564479 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c7f88de9-a4d3-4864-a04e-f85d3346363a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Action: 'create', calling method: .version_select at 0x7f112f664040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1444697296"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:03.585220 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-c7f88de9-a4d3-4864-a04e-f85d3346363a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Getting quotas for project c1f5daa1c5be44b48448e0480398d984. Resources: {'key_pairs'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:53:03.589852 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-c7f88de9-a4d3-4864-a04e-f85d3346363a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Getting quotas for user 904f531e946b4c37a26ff75451b41923 and project c1f5daa1c5be44b48448e0480398d984. Resources: {'key_pairs'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:53:03.628757 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-fbb6abfc-f159-44af-b71b-bd8147952fce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:03.630058 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-fbb6abfc-f159-44af-b71b-bd8147952fce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:03.639440 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fbb6abfc-f159-44af-b71b-bd8147952fce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:03.640310 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fbb6abfc-f159-44af-b71b-bd8147952fce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:03.641254 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fbb6abfc-f159-44af-b71b-bd8147952fce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:03.641845 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fbb6abfc-f159-44af-b71b-bd8147952fce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:03.773209 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-fbb6abfc-f159-44af-b71b-bd8147952fce tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 19342 microversion: 2.20 time: 0.150434 Nov 02 16:53:03.775407 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 457/937] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:03 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 19342 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:03.961940 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-c7f88de9-a4d3-4864-a04e-f85d3346363a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Getting quotas for project c1f5daa1c5be44b48448e0480398d984. Resources: {'key_pairs'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:53:03.966685 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-c7f88de9-a4d3-4864-a04e-f85d3346363a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Getting quotas for user 904f531e946b4c37a26ff75451b41923 and project c1f5daa1c5be44b48448e0480398d984. Resources: {'key_pairs'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:53:03.981874 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c7f88de9-a4d3-4864-a04e-f85d3346363a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.610490 Nov 02 16:53:03.982787 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 481/938] 10.222.0.118 () {60 vars in 1162 bytes} [Tue Nov 2 16:53:03 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:04.241453 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9e4b9c10-55f6-4c8d-980c-0c6d7816dca1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:04.241453 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9e4b9c10-55f6-4c8d-980c-0c6d7816dca1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:04.253033 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e4b9c10-55f6-4c8d-980c-0c6d7816dca1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:04.253825 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e4b9c10-55f6-4c8d-980c-0c6d7816dca1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:04.255046 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e4b9c10-55f6-4c8d-980c-0c6d7816dca1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:04.255489 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e4b9c10-55f6-4c8d-980c-0c6d7816dca1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:04.541496 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9e4b9c10-55f6-4c8d-980c-0c6d7816dca1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:04.555450 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9e4b9c10-55f6-4c8d-980c-0c6d7816dca1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1366 microversion: 2.1 time: 0.322575 Nov 02 16:53:04.556056 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 458/939] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:04 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:53:04.787880 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e0945b01-253a-4a5c-b314-9977d93c3808 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:04.790034 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e0945b01-253a-4a5c-b314-9977d93c3808 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:04.808509 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e0945b01-253a-4a5c-b314-9977d93c3808 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:04.808999 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e0945b01-253a-4a5c-b314-9977d93c3808 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:04.809875 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e0945b01-253a-4a5c-b314-9977d93c3808 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:04.810331 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e0945b01-253a-4a5c-b314-9977d93c3808 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:04.905791 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e0945b01-253a-4a5c-b314-9977d93c3808 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 21929 microversion: 2.20 time: 0.122276 Nov 02 16:53:04.906763 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 482/940] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:04 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 21929 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:53:05.573203 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-02e085e2-7312-4680-be88-6666564caf76 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:05.574024 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-02e085e2-7312-4680-be88-6666564caf76 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:05.581726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02e085e2-7312-4680-be88-6666564caf76 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:05.582461 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02e085e2-7312-4680-be88-6666564caf76 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:05.583406 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02e085e2-7312-4680-be88-6666564caf76 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:05.583974 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02e085e2-7312-4680-be88-6666564caf76 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:05.771845 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-02e085e2-7312-4680-be88-6666564caf76 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:05.780967 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-02e085e2-7312-4680-be88-6666564caf76 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1366 microversion: 2.1 time: 0.212193 Nov 02 16:53:05.781653 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 459/941] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:05 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:05.812113 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-8066247b-e8c1-487b-a178-0f0a2fe7548e req-02a00771-3588-4811-9399-8479cd6b4f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61572fbe-ccf7-4ed4-80ab-eda95f187229", "name": "network-vif-plugged", "status": "completed", "tag": "f902bd79-9248-4da6-847e-36b46e3fa1b9"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:05.814561 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:53:05.814561 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:53:05.826889 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-8066247b-e8c1-487b-a178-0f0a2fe7548e req-02a00771-3588-4811-9399-8479cd6b4f3f service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:05.827359 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-8066247b-e8c1-487b-a178-0f0a2fe7548e req-02a00771-3588-4811-9399-8479cd6b4f3f service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:05.844218 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-8066247b-e8c1-487b-a178-0f0a2fe7548e req-02a00771-3588-4811-9399-8479cd6b4f3f service nova] Creating event network-vif-plugged:f902bd79-9248-4da6-847e-36b46e3fa1b9 for instance 61572fbe-ccf7-4ed4-80ab-eda95f187229 on hv-cinder-77387 Nov 02 16:53:05.850172 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-8066247b-e8c1-487b-a178-0f0a2fe7548e req-02a00771-3588-4811-9399-8479cd6b4f3f service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043381 Nov 02 16:53:05.850859 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 483/942] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:53:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:53:05.921908 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cbae1b3a-6e67-4952-bebd-b75d84215e65 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:05.923101 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-cbae1b3a-6e67-4952-bebd-b75d84215e65 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:05.934978 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cbae1b3a-6e67-4952-bebd-b75d84215e65 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:05.935920 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cbae1b3a-6e67-4952-bebd-b75d84215e65 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:05.936919 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cbae1b3a-6e67-4952-bebd-b75d84215e65 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:05.937409 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cbae1b3a-6e67-4952-bebd-b75d84215e65 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:06.051117 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-cbae1b3a-6e67-4952-bebd-b75d84215e65 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 23221 microversion: 2.20 time: 0.137088 Nov 02 16:53:06.051890 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 460/943] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:05 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 23221 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:53:06.811475 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a4735a77-85dc-46cb-969a-123a60edf8ac tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:06.812404 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a4735a77-85dc-46cb-969a-123a60edf8ac tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:06.822231 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a4735a77-85dc-46cb-969a-123a60edf8ac tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:06.822722 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a4735a77-85dc-46cb-969a-123a60edf8ac tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:06.823626 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a4735a77-85dc-46cb-969a-123a60edf8ac tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:06.824076 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a4735a77-85dc-46cb-969a-123a60edf8ac tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:07.040078 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a4735a77-85dc-46cb-969a-123a60edf8ac tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:07.049556 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a4735a77-85dc-46cb-969a-123a60edf8ac tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1366 microversion: 2.1 time: 0.253467 Nov 02 16:53:07.051111 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 484/944] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:06 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:07.064927 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-02b440a1-5466-4f1e-989b-25fce1f6ef88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:07.068413 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-02b440a1-5466-4f1e-989b-25fce1f6ef88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:07.076466 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02b440a1-5466-4f1e-989b-25fce1f6ef88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:07.076936 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02b440a1-5466-4f1e-989b-25fce1f6ef88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:07.078003 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02b440a1-5466-4f1e-989b-25fce1f6ef88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:07.078449 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02b440a1-5466-4f1e-989b-25fce1f6ef88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:07.189302 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-02b440a1-5466-4f1e-989b-25fce1f6ef88 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 23797 microversion: 2.20 time: 0.129279 Nov 02 16:53:07.190058 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 461/945] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:07 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 23797 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:08.069955 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3834e03e-41cd-4c4d-af64-c161724ea695 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:08.071384 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3834e03e-41cd-4c4d-af64-c161724ea695 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:08.079142 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3834e03e-41cd-4c4d-af64-c161724ea695 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:08.079608 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3834e03e-41cd-4c4d-af64-c161724ea695 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:08.080502 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3834e03e-41cd-4c4d-af64-c161724ea695 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:08.081077 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3834e03e-41cd-4c4d-af64-c161724ea695 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:08.203259 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c90b3652-287c-4662-9fcf-681b5c3006eb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:08.204119 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c90b3652-287c-4662-9fcf-681b5c3006eb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:08.213933 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c90b3652-287c-4662-9fcf-681b5c3006eb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:08.214413 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c90b3652-287c-4662-9fcf-681b5c3006eb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:08.215304 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c90b3652-287c-4662-9fcf-681b5c3006eb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:08.215715 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c90b3652-287c-4662-9fcf-681b5c3006eb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:08.246252 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3834e03e-41cd-4c4d-af64-c161724ea695 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:08.261038 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3834e03e-41cd-4c4d-af64-c161724ea695 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1552 microversion: 2.1 time: 0.195082 Nov 02 16:53:08.261719 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 485/946] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:08 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1552 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:08.280563 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-dd9eb9cf-d6de-461b-a588-5b985bb3dc2e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:08.281321 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-dd9eb9cf-d6de-461b-a588-5b985bb3dc2e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:08.289598 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dd9eb9cf-d6de-461b-a588-5b985bb3dc2e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:08.290038 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dd9eb9cf-d6de-461b-a588-5b985bb3dc2e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:08.291077 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dd9eb9cf-d6de-461b-a588-5b985bb3dc2e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:08.291523 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dd9eb9cf-d6de-461b-a588-5b985bb3dc2e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:08.344576 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c90b3652-287c-4662-9fcf-681b5c3006eb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 24509 microversion: 2.20 time: 0.145344 Nov 02 16:53:08.345929 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 462/947] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:08 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 24509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:08.403892 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-dd9eb9cf-d6de-461b-a588-5b985bb3dc2e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128567 Nov 02 16:53:08.406572 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 486/948] 10.222.0.118 () {58 vars in 1279 bytes} [Tue Nov 2 16:53:08 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:53:09.361654 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-033ea5a1-e409-430b-997c-0033f69b5382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:09.364001 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-033ea5a1-e409-430b-997c-0033f69b5382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:09.375183 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-033ea5a1-e409-430b-997c-0033f69b5382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:09.376647 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-033ea5a1-e409-430b-997c-0033f69b5382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:09.377970 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-033ea5a1-e409-430b-997c-0033f69b5382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:09.378937 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-033ea5a1-e409-430b-997c-0033f69b5382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:09.502198 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-033ea5a1-e409-430b-997c-0033f69b5382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 25472 microversion: 2.20 time: 0.146029 Nov 02 16:53:09.509676 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 463/949] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:09 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 25472 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:10.133983 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8f6f997c-128d-43ef-8964-575054dc934d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:10.136009 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8f6f997c-128d-43ef-8964-575054dc934d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:10.140482 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-96b4f14d-5cc6-49d7-8374-5ae034179861 req-e8b6e11c-e545-44c7-be28-3acd5b7b3d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61572fbe-ccf7-4ed4-80ab-eda95f187229", "tag": "f902bd79-9248-4da6-847e-36b46e3fa1b9"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:10.142391 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:53:10.142391 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:53:10.144461 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8f6f997c-128d-43ef-8964-575054dc934d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:10.144938 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8f6f997c-128d-43ef-8964-575054dc934d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:10.145780 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8f6f997c-128d-43ef-8964-575054dc934d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:10.146235 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8f6f997c-128d-43ef-8964-575054dc934d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:10.152865 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-96b4f14d-5cc6-49d7-8374-5ae034179861 req-e8b6e11c-e545-44c7-be28-3acd5b7b3d41 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:10.153310 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-96b4f14d-5cc6-49d7-8374-5ae034179861 req-e8b6e11c-e545-44c7-be28-3acd5b7b3d41 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:10.168086 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-96b4f14d-5cc6-49d7-8374-5ae034179861 req-e8b6e11c-e545-44c7-be28-3acd5b7b3d41 service nova] Creating event network-changed:f902bd79-9248-4da6-847e-36b46e3fa1b9 for instance 61572fbe-ccf7-4ed4-80ab-eda95f187229 on hv-cinder-77387 Nov 02 16:53:10.176028 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-96b4f14d-5cc6-49d7-8374-5ae034179861 req-e8b6e11c-e545-44c7-be28-3acd5b7b3d41 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047218 Nov 02 16:53:10.183898 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 464/950] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:53:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:53:10.247219 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8f6f997c-128d-43ef-8964-575054dc934d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.122519 Nov 02 16:53:10.247956 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 487/951] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:10 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:10.518978 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e49d14dc-9948-4d64-b99b-0a14de61cf4a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:10.520527 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e49d14dc-9948-4d64-b99b-0a14de61cf4a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:10.528942 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e49d14dc-9948-4d64-b99b-0a14de61cf4a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:10.529830 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e49d14dc-9948-4d64-b99b-0a14de61cf4a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:10.530893 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e49d14dc-9948-4d64-b99b-0a14de61cf4a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:10.531543 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e49d14dc-9948-4d64-b99b-0a14de61cf4a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:10.625062 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e49d14dc-9948-4d64-b99b-0a14de61cf4a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 26253 microversion: 2.20 time: 0.111166 Nov 02 16:53:10.626460 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 465/952] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:10 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 26253 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:11.260077 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-68374cc2-19bf-43ee-baa7-258659eff4b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:11.261471 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-68374cc2-19bf-43ee-baa7-258659eff4b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:11.269810 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-68374cc2-19bf-43ee-baa7-258659eff4b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:11.270414 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-68374cc2-19bf-43ee-baa7-258659eff4b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:11.271106 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-68374cc2-19bf-43ee-baa7-258659eff4b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:11.271788 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-68374cc2-19bf-43ee-baa7-258659eff4b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:11.377308 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-68374cc2-19bf-43ee-baa7-258659eff4b6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.121574 Nov 02 16:53:11.378232 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 488/953] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:11 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:11.643452 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-138f6627-f882-4b6a-9861-b22c7b56c02d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:11.644824 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-138f6627-f882-4b6a-9861-b22c7b56c02d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:11.654670 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-138f6627-f882-4b6a-9861-b22c7b56c02d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:11.655140 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-138f6627-f882-4b6a-9861-b22c7b56c02d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:11.656015 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-138f6627-f882-4b6a-9861-b22c7b56c02d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:11.656500 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-138f6627-f882-4b6a-9861-b22c7b56c02d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:11.770105 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-138f6627-f882-4b6a-9861-b22c7b56c02d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 26954 microversion: 2.20 time: 0.133406 Nov 02 16:53:11.770889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 466/954] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:11 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 26954 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:12.391156 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4b4aa632-e316-43c3-b1f8-88a5078cc0ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:12.392083 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4b4aa632-e316-43c3-b1f8-88a5078cc0ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:12.401489 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4b4aa632-e316-43c3-b1f8-88a5078cc0ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:12.401961 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4b4aa632-e316-43c3-b1f8-88a5078cc0ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:12.402828 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4b4aa632-e316-43c3-b1f8-88a5078cc0ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:12.403271 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4b4aa632-e316-43c3-b1f8-88a5078cc0ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:12.480767 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4b4aa632-e316-43c3-b1f8-88a5078cc0ca tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.094143 Nov 02 16:53:12.481501 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 489/955] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:12 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:12.785771 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c3b6a365-9125-4477-8ff5-e0c31dc77d4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:12.787163 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c3b6a365-9125-4477-8ff5-e0c31dc77d4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:12.796628 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c3b6a365-9125-4477-8ff5-e0c31dc77d4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:12.797347 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c3b6a365-9125-4477-8ff5-e0c31dc77d4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:12.798030 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c3b6a365-9125-4477-8ff5-e0c31dc77d4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:12.798470 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c3b6a365-9125-4477-8ff5-e0c31dc77d4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:12.909094 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c3b6a365-9125-4477-8ff5-e0c31dc77d4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 27332 microversion: 2.20 time: 0.128869 Nov 02 16:53:12.909837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 467/956] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:12 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 27332 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:13.494935 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b8f1215d-7300-4f2d-a16b-18248e163b22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:13.496040 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b8f1215d-7300-4f2d-a16b-18248e163b22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:13.504262 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b8f1215d-7300-4f2d-a16b-18248e163b22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:13.504747 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b8f1215d-7300-4f2d-a16b-18248e163b22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:13.505759 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b8f1215d-7300-4f2d-a16b-18248e163b22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:13.506242 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b8f1215d-7300-4f2d-a16b-18248e163b22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:13.612253 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b8f1215d-7300-4f2d-a16b-18248e163b22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.122665 Nov 02 16:53:13.612988 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 490/957] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:13 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:13.922796 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-14096d50-0a32-4166-93d5-02fcd0f67a0a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:13.924028 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-14096d50-0a32-4166-93d5-02fcd0f67a0a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:13.932149 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-14096d50-0a32-4166-93d5-02fcd0f67a0a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:13.932643 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-14096d50-0a32-4166-93d5-02fcd0f67a0a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:13.933465 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-14096d50-0a32-4166-93d5-02fcd0f67a0a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:13.933911 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-14096d50-0a32-4166-93d5-02fcd0f67a0a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:14.029415 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-14096d50-0a32-4166-93d5-02fcd0f67a0a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 27577 microversion: 2.20 time: 0.110956 Nov 02 16:53:14.030047 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 468/958] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:13 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 27577 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:53:14.625559 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3bf8ba51-463d-4234-bc0b-5dbdeac677f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:14.626669 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3bf8ba51-463d-4234-bc0b-5dbdeac677f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:14.637664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3bf8ba51-463d-4234-bc0b-5dbdeac677f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:14.638239 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3bf8ba51-463d-4234-bc0b-5dbdeac677f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:14.639188 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3bf8ba51-463d-4234-bc0b-5dbdeac677f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:14.639610 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3bf8ba51-463d-4234-bc0b-5dbdeac677f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:14.738457 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3bf8ba51-463d-4234-bc0b-5dbdeac677f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.117408 Nov 02 16:53:14.739206 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 491/959] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:14 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:15.042849 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-17df9afa-5b4a-4053-b4af-8a600785b3c8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:15.043951 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-17df9afa-5b4a-4053-b4af-8a600785b3c8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:15.051997 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-17df9afa-5b4a-4053-b4af-8a600785b3c8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:15.052510 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-17df9afa-5b4a-4053-b4af-8a600785b3c8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:15.053338 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-17df9afa-5b4a-4053-b4af-8a600785b3c8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:15.053779 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-17df9afa-5b4a-4053-b4af-8a600785b3c8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:15.180037 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-17df9afa-5b4a-4053-b4af-8a600785b3c8 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 27762 microversion: 2.20 time: 0.141658 Nov 02 16:53:15.181218 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 469/960] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:15 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 27762 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:15.750820 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fa32dc69-f625-4937-b0eb-b8bbe71a97f6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:15.751941 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fa32dc69-f625-4937-b0eb-b8bbe71a97f6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:15.761270 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fa32dc69-f625-4937-b0eb-b8bbe71a97f6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:15.761738 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fa32dc69-f625-4937-b0eb-b8bbe71a97f6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:15.762580 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fa32dc69-f625-4937-b0eb-b8bbe71a97f6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:15.763036 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fa32dc69-f625-4937-b0eb-b8bbe71a97f6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:15.859442 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fa32dc69-f625-4937-b0eb-b8bbe71a97f6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.113004 Nov 02 16:53:15.860195 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 492/961] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:15 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:16.194347 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a1843f63-709d-4901-9591-efac51d17b6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:16.196167 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a1843f63-709d-4901-9591-efac51d17b6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:16.203902 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a1843f63-709d-4901-9591-efac51d17b6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:16.204414 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a1843f63-709d-4901-9591-efac51d17b6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:16.205225 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a1843f63-709d-4901-9591-efac51d17b6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:16.205676 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a1843f63-709d-4901-9591-efac51d17b6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:16.314483 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a1843f63-709d-4901-9591-efac51d17b6d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 28084 microversion: 2.20 time: 0.124664 Nov 02 16:53:16.315297 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 470/962] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:16 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 28084 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:16.872650 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9a636de5-f537-42e5-b8ca-619ca8dea620 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:16.873640 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9a636de5-f537-42e5-b8ca-619ca8dea620 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:16.881443 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9a636de5-f537-42e5-b8ca-619ca8dea620 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:16.881933 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9a636de5-f537-42e5-b8ca-619ca8dea620 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:16.883373 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9a636de5-f537-42e5-b8ca-619ca8dea620 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:16.884109 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9a636de5-f537-42e5-b8ca-619ca8dea620 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:16.964852 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9a636de5-f537-42e5-b8ca-619ca8dea620 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.096568 Nov 02 16:53:16.965571 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 493/963] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:16 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:17.335721 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-94304a98-5f50-448a-9d17-cd447850cd7b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:17.337276 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-94304a98-5f50-448a-9d17-cd447850cd7b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:17.345572 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-94304a98-5f50-448a-9d17-cd447850cd7b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:17.346041 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-94304a98-5f50-448a-9d17-cd447850cd7b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:17.346863 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-94304a98-5f50-448a-9d17-cd447850cd7b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:17.347321 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-94304a98-5f50-448a-9d17-cd447850cd7b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:17.466399 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-94304a98-5f50-448a-9d17-cd447850cd7b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 28185 microversion: 2.20 time: 0.142241 Nov 02 16:53:17.467176 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 471/964] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:17 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 28185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:17.976388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ca1ed1a1-b34c-49f5-878a-9ff33e6410f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:17.977629 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ca1ed1a1-b34c-49f5-878a-9ff33e6410f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:17.985398 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ca1ed1a1-b34c-49f5-878a-9ff33e6410f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:17.985861 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ca1ed1a1-b34c-49f5-878a-9ff33e6410f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:17.986659 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ca1ed1a1-b34c-49f5-878a-9ff33e6410f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:17.987100 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ca1ed1a1-b34c-49f5-878a-9ff33e6410f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:18.067703 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ca1ed1a1-b34c-49f5-878a-9ff33e6410f1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.095728 Nov 02 16:53:18.068692 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 494/965] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:17 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:18.481479 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-82261946-3c14-4b9c-9d43-70e2dffbf430 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:18.482554 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-82261946-3c14-4b9c-9d43-70e2dffbf430 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:18.491900 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-82261946-3c14-4b9c-9d43-70e2dffbf430 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:18.492226 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-82261946-3c14-4b9c-9d43-70e2dffbf430 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:18.492924 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-82261946-3c14-4b9c-9d43-70e2dffbf430 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:18.493374 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-82261946-3c14-4b9c-9d43-70e2dffbf430 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:18.597375 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-82261946-3c14-4b9c-9d43-70e2dffbf430 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 28185 microversion: 2.20 time: 0.120890 Nov 02 16:53:18.597996 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 472/966] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:18 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 28185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:19.080643 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-409a1cb7-7635-44c0-8d0d-62c7ae4c4f3f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:19.081753 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-409a1cb7-7635-44c0-8d0d-62c7ae4c4f3f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:19.090283 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-409a1cb7-7635-44c0-8d0d-62c7ae4c4f3f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:19.090754 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-409a1cb7-7635-44c0-8d0d-62c7ae4c4f3f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:19.091567 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-409a1cb7-7635-44c0-8d0d-62c7ae4c4f3f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:19.092020 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-409a1cb7-7635-44c0-8d0d-62c7ae4c4f3f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:19.183470 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-409a1cb7-7635-44c0-8d0d-62c7ae4c4f3f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.107188 Nov 02 16:53:19.184227 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 495/967] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:19 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:19.611497 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-38edce4d-f1dd-4fcd-9b50-ff773c5788a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:19.612607 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-38edce4d-f1dd-4fcd-9b50-ff773c5788a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:19.621726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-38edce4d-f1dd-4fcd-9b50-ff773c5788a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:19.622192 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-38edce4d-f1dd-4fcd-9b50-ff773c5788a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:19.623017 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-38edce4d-f1dd-4fcd-9b50-ff773c5788a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:19.623498 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-38edce4d-f1dd-4fcd-9b50-ff773c5788a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:19.742558 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-38edce4d-f1dd-4fcd-9b50-ff773c5788a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 28217 microversion: 2.20 time: 0.134784 Nov 02 16:53:19.743184 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 473/968] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:19 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 28217 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:20.196033 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-76f2359d-c4d1-4a9e-8eb5-a0e881d71ee1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:20.197172 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-76f2359d-c4d1-4a9e-8eb5-a0e881d71ee1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:20.205976 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-76f2359d-c4d1-4a9e-8eb5-a0e881d71ee1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:20.207761 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-76f2359d-c4d1-4a9e-8eb5-a0e881d71ee1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:20.207761 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-76f2359d-c4d1-4a9e-8eb5-a0e881d71ee1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:20.208127 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-76f2359d-c4d1-4a9e-8eb5-a0e881d71ee1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:20.300226 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-76f2359d-c4d1-4a9e-8eb5-a0e881d71ee1 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.108724 Nov 02 16:53:20.302106 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 496/969] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:20 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:20.756129 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6b6143ca-7de0-4999-8a16-fa5e116b17f4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:20.757189 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6b6143ca-7de0-4999-8a16-fa5e116b17f4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:20.766368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6b6143ca-7de0-4999-8a16-fa5e116b17f4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:20.766671 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6b6143ca-7de0-4999-8a16-fa5e116b17f4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:20.767442 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6b6143ca-7de0-4999-8a16-fa5e116b17f4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:20.767895 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6b6143ca-7de0-4999-8a16-fa5e116b17f4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:20.872823 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6b6143ca-7de0-4999-8a16-fa5e116b17f4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 28475 microversion: 2.20 time: 0.121050 Nov 02 16:53:20.873444 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 474/970] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:20 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 28475 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:21.313738 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-739c18e1-144e-4352-ae5e-8360ceac8e75 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:21.314907 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-739c18e1-144e-4352-ae5e-8360ceac8e75 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:21.322925 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-739c18e1-144e-4352-ae5e-8360ceac8e75 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:21.323484 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-739c18e1-144e-4352-ae5e-8360ceac8e75 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:21.324371 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-739c18e1-144e-4352-ae5e-8360ceac8e75 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:21.324819 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-739c18e1-144e-4352-ae5e-8360ceac8e75 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:21.433663 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-739c18e1-144e-4352-ae5e-8360ceac8e75 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.124163 Nov 02 16:53:21.434395 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 497/971] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:21 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:21.887354 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e4673553-46d6-47a9-8adb-d1626e09ba76 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:21.888365 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e4673553-46d6-47a9-8adb-d1626e09ba76 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:21.896867 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4673553-46d6-47a9-8adb-d1626e09ba76 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:21.897341 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4673553-46d6-47a9-8adb-d1626e09ba76 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:21.899063 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4673553-46d6-47a9-8adb-d1626e09ba76 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:21.899522 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4673553-46d6-47a9-8adb-d1626e09ba76 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:22.024250 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e4673553-46d6-47a9-8adb-d1626e09ba76 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 28491 microversion: 2.20 time: 0.142429 Nov 02 16:53:22.025043 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 475/972] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:21 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 28491 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:22.445819 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c573eb08-3d2b-4522-9ffc-e9d15ede5a70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:22.446911 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c573eb08-3d2b-4522-9ffc-e9d15ede5a70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:22.455056 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c573eb08-3d2b-4522-9ffc-e9d15ede5a70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:22.455530 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c573eb08-3d2b-4522-9ffc-e9d15ede5a70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:22.456427 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c573eb08-3d2b-4522-9ffc-e9d15ede5a70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:22.456939 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c573eb08-3d2b-4522-9ffc-e9d15ede5a70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:22.543677 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c573eb08-3d2b-4522-9ffc-e9d15ede5a70 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.102270 Nov 02 16:53:22.544642 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 498/973] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:22 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:23.041886 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-25eafe55-6538-4b5b-b5e8-7cf60538aa62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:23.043668 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-25eafe55-6538-4b5b-b5e8-7cf60538aa62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:23.054238 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-25eafe55-6538-4b5b-b5e8-7cf60538aa62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:23.055076 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-25eafe55-6538-4b5b-b5e8-7cf60538aa62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:23.056608 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-25eafe55-6538-4b5b-b5e8-7cf60538aa62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:23.057416 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-25eafe55-6538-4b5b-b5e8-7cf60538aa62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:23.177205 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-25eafe55-6538-4b5b-b5e8-7cf60538aa62 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 28643 microversion: 2.20 time: 0.143536 Nov 02 16:53:23.177963 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 476/974] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:23 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 28643 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:23.556845 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-859d08b8-343f-4913-93d0-be400fd795ff tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:23.558058 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-859d08b8-343f-4913-93d0-be400fd795ff tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:23.567583 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-859d08b8-343f-4913-93d0-be400fd795ff tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:23.568048 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-859d08b8-343f-4913-93d0-be400fd795ff tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:23.568921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-859d08b8-343f-4913-93d0-be400fd795ff tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:23.569364 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-859d08b8-343f-4913-93d0-be400fd795ff tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:23.648463 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-859d08b8-343f-4913-93d0-be400fd795ff tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.096632 Nov 02 16:53:23.649282 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 499/975] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:23 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:24.191625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-da709cfb-6bb5-4988-a76c-121d72312813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:24.192861 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-da709cfb-6bb5-4988-a76c-121d72312813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:24.201756 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-da709cfb-6bb5-4988-a76c-121d72312813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:24.202224 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-da709cfb-6bb5-4988-a76c-121d72312813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:24.203058 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-da709cfb-6bb5-4988-a76c-121d72312813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:24.203525 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-da709cfb-6bb5-4988-a76c-121d72312813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:24.291354 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-da709cfb-6bb5-4988-a76c-121d72312813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 28643 microversion: 2.20 time: 0.103977 Nov 02 16:53:24.292106 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 477/976] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:24 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 28643 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:24.661621 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-adac4c09-5ad4-4820-bd59-85d8d58629b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:24.662711 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-adac4c09-5ad4-4820-bd59-85d8d58629b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:24.672164 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-adac4c09-5ad4-4820-bd59-85d8d58629b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:24.672662 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-adac4c09-5ad4-4820-bd59-85d8d58629b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:24.673503 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-adac4c09-5ad4-4820-bd59-85d8d58629b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:24.673957 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-adac4c09-5ad4-4820-bd59-85d8d58629b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:24.761032 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-adac4c09-5ad4-4820-bd59-85d8d58629b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.103449 Nov 02 16:53:24.761786 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 500/977] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:24 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:25.305198 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a5edf779-4634-4555-ab9f-1ad8576ba14b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:25.307106 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a5edf779-4634-4555-ab9f-1ad8576ba14b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:25.315011 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a5edf779-4634-4555-ab9f-1ad8576ba14b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:25.315479 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a5edf779-4634-4555-ab9f-1ad8576ba14b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:25.316415 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a5edf779-4634-4555-ab9f-1ad8576ba14b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:25.316867 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a5edf779-4634-4555-ab9f-1ad8576ba14b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:25.417016 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a5edf779-4634-4555-ab9f-1ad8576ba14b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 28643 microversion: 2.20 time: 0.116502 Nov 02 16:53:25.418246 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 478/978] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:25 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 28643 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:25.773658 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7f37c999-7b0c-4545-a280-b441292807aa tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:25.774899 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7f37c999-7b0c-4545-a280-b441292807aa tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:25.783061 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7f37c999-7b0c-4545-a280-b441292807aa tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:25.783541 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7f37c999-7b0c-4545-a280-b441292807aa tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:25.784413 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7f37c999-7b0c-4545-a280-b441292807aa tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:25.784951 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7f37c999-7b0c-4545-a280-b441292807aa tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:25.874503 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7f37c999-7b0c-4545-a280-b441292807aa tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.105805 Nov 02 16:53:25.875301 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 501/979] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:25 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:26.430625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9b5352c7-87cd-436a-b74f-639d2483e0db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:26.431686 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9b5352c7-87cd-436a-b74f-639d2483e0db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:26.439426 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9b5352c7-87cd-436a-b74f-639d2483e0db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:26.439889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9b5352c7-87cd-436a-b74f-639d2483e0db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:26.440723 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9b5352c7-87cd-436a-b74f-639d2483e0db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:26.441171 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9b5352c7-87cd-436a-b74f-639d2483e0db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:26.527072 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9b5352c7-87cd-436a-b74f-639d2483e0db tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 28643 microversion: 2.20 time: 0.100964 Nov 02 16:53:26.527688 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 479/980] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:26 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 28643 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:26.887583 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-71a9109c-3242-4820-b44e-7a204e8444ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:26.888678 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-71a9109c-3242-4820-b44e-7a204e8444ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:26.897534 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-71a9109c-3242-4820-b44e-7a204e8444ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:26.898006 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-71a9109c-3242-4820-b44e-7a204e8444ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:26.898840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-71a9109c-3242-4820-b44e-7a204e8444ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:26.899336 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-71a9109c-3242-4820-b44e-7a204e8444ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:26.989407 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-71a9109c-3242-4820-b44e-7a204e8444ce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 14 microversion: 2.1 time: 0.106659 Nov 02 16:53:26.990508 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 502/981] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:26 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:53:27.540495 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1f10323c-8535-48a7-92f0-fd26a2f9343a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:27.541457 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1f10323c-8535-48a7-92f0-fd26a2f9343a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:27.550054 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1f10323c-8535-48a7-92f0-fd26a2f9343a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:27.550518 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1f10323c-8535-48a7-92f0-fd26a2f9343a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:27.551342 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1f10323c-8535-48a7-92f0-fd26a2f9343a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:27.551798 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1f10323c-8535-48a7-92f0-fd26a2f9343a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:27.661432 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1f10323c-8535-48a7-92f0-fd26a2f9343a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 28643 microversion: 2.20 time: 0.125441 Nov 02 16:53:27.662518 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 480/982] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:27 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 28643 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:28.003255 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5697a247-449a-4373-822f-e24a4ed7dc58 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:28.004386 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5697a247-449a-4373-822f-e24a4ed7dc58 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:28.013259 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5697a247-449a-4373-822f-e24a4ed7dc58 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:28.013736 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5697a247-449a-4373-822f-e24a4ed7dc58 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:28.014628 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5697a247-449a-4373-822f-e24a4ed7dc58 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:28.015083 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5697a247-449a-4373-822f-e24a4ed7dc58 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:28.126233 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5697a247-449a-4373-822f-e24a4ed7dc58 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 784 microversion: 2.1 time: 0.127235 Nov 02 16:53:28.126882 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 503/983] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:27 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 784 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:53:28.675457 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b9b307ae-5606-464e-912a-3d8af2271dfe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:28.676617 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b9b307ae-5606-464e-912a-3d8af2271dfe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:28.685462 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b9b307ae-5606-464e-912a-3d8af2271dfe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:28.685929 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b9b307ae-5606-464e-912a-3d8af2271dfe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:28.686775 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b9b307ae-5606-464e-912a-3d8af2271dfe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:28.687231 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b9b307ae-5606-464e-912a-3d8af2271dfe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:28.776352 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b9b307ae-5606-464e-912a-3d8af2271dfe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 28643 microversion: 2.20 time: 0.105382 Nov 02 16:53:28.777095 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 481/984] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:28 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 28643 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:29.140272 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3d38b66d-9484-4e50-b805-31c9836f8b43 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:29.141263 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3d38b66d-9484-4e50-b805-31c9836f8b43 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:29.149803 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3d38b66d-9484-4e50-b805-31c9836f8b43 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:29.150269 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3d38b66d-9484-4e50-b805-31c9836f8b43 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:29.151083 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3d38b66d-9484-4e50-b805-31c9836f8b43 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:29.151535 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3d38b66d-9484-4e50-b805-31c9836f8b43 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:29.232646 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3d38b66d-9484-4e50-b805-31c9836f8b43 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 9039 microversion: 2.1 time: 0.097440 Nov 02 16:53:29.233417 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 504/985] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:29 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 9039 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:29.790758 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-64fd4676-caa7-4405-91e3-5996b461f465 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:29.791845 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-64fd4676-caa7-4405-91e3-5996b461f465 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:29.800298 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-64fd4676-caa7-4405-91e3-5996b461f465 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:29.800769 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-64fd4676-caa7-4405-91e3-5996b461f465 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:29.801603 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-64fd4676-caa7-4405-91e3-5996b461f465 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:29.802108 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-64fd4676-caa7-4405-91e3-5996b461f465 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:29.885811 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-64fd4676-caa7-4405-91e3-5996b461f465 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 28948 microversion: 2.20 time: 0.099871 Nov 02 16:53:29.886591 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 482/986] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:29 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 28948 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:30.024735 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1192750111", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1444697296", "security_groups": [{"name": "tempest-secgroup-smoke-1589840641"}], "networks": [{"uuid": "ef399344-c729-4536-b6ad-dc1eae816e3b"}], "block_device_mapping_v2": [{"uuid": "8120d2a9-a020-486e-9bc1-85a4a123595a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:30.156238 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.network.neutron [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] validate_networks() for [('ef399344-c729-4536-b6ad-dc1eae816e3b', None, None, None, None, None)] {{(pid=127649) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:53:30.248061 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-02e22c16-7f32-4a94-9f68-f71a2c5e72b4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:30.248957 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-02e22c16-7f32-4a94-9f68-f71a2c5e72b4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:30.257834 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02e22c16-7f32-4a94-9f68-f71a2c5e72b4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:30.258326 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02e22c16-7f32-4a94-9f68-f71a2c5e72b4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:30.259209 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02e22c16-7f32-4a94-9f68-f71a2c5e72b4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:30.259677 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-02e22c16-7f32-4a94-9f68-f71a2c5e72b4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:30.353984 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-02e22c16-7f32-4a94-9f68-f71a2c5e72b4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 15025 microversion: 2.1 time: 0.110902 Nov 02 16:53:30.354795 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 483/987] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:30 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 15025 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:53:30.573553 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Flavor limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:53:30.573993 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Image limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:53:30.574483 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Flavor pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:53:30.574932 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Image pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:53:30.575351 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:53:30.586419 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:30.586884 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:30.587983 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:30.588466 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:30.607374 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Getting quotas for project c1f5daa1c5be44b48448e0480398d984. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:53:30.611536 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Getting quotas for user 904f531e946b4c37a26ff75451b41923 and project c1f5daa1c5be44b48448e0480398d984. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:53:30.674655 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Going to run 1 instances... {{(pid=127649) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:53:30.677263 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8120d2a9-a020-486e-9bc1-85a4a123595a',volume_size=None,volume_type=None)] {{(pid=127649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:53:30.822750 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5aee7be9-f7a1-4e40-9f18-3f696a1c8bc5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.802472 Nov 02 16:53:30.823372 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 505/988] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:53:30 2021] POST /compute/v2.1/servers => generated 408 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:53:30.836073 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9e23e23d-ce24-4202-b966-6d8241500dcf tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:30.836907 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9e23e23d-ce24-4202-b966-6d8241500dcf tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:30.903537 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5a5f13cb-d8b0-4522-b0a9-772059623d7d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:30.905948 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5a5f13cb-d8b0-4522-b0a9-772059623d7d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:30.911343 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9e23e23d-ce24-4202-b966-6d8241500dcf tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:30.918388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5a5f13cb-d8b0-4522-b0a9-772059623d7d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:30.918865 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5a5f13cb-d8b0-4522-b0a9-772059623d7d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:30.919727 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5a5f13cb-d8b0-4522-b0a9-772059623d7d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:30.919905 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9e23e23d-ce24-4202-b966-6d8241500dcf tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1092 microversion: 2.1 time: 0.088899 Nov 02 16:53:30.920206 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5a5f13cb-d8b0-4522-b0a9-772059623d7d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:30.920827 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 484/989] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:30 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1092 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:31.051966 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5a5f13cb-d8b0-4522-b0a9-772059623d7d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 30410 microversion: 2.20 time: 0.154528 Nov 02 16:53:31.052916 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 506/990] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:30 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 30410 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 02 16:53:31.370897 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-28df74bc-5a55-48ba-8515-1c1d23105c09 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:31.372144 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-28df74bc-5a55-48ba-8515-1c1d23105c09 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:31.382968 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-28df74bc-5a55-48ba-8515-1c1d23105c09 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:31.383471 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-28df74bc-5a55-48ba-8515-1c1d23105c09 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:31.384408 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-28df74bc-5a55-48ba-8515-1c1d23105c09 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:31.384864 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-28df74bc-5a55-48ba-8515-1c1d23105c09 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:31.487233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-28df74bc-5a55-48ba-8515-1c1d23105c09 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 17931 microversion: 2.1 time: 0.122383 Nov 02 16:53:31.488794 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 485/991] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:31 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 17931 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:53:31.939935 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c51549b7-48f9-41f0-85e5-743206868e42 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:31.940751 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c51549b7-48f9-41f0-85e5-743206868e42 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:31.949555 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c51549b7-48f9-41f0-85e5-743206868e42 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:31.950369 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c51549b7-48f9-41f0-85e5-743206868e42 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:31.951260 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c51549b7-48f9-41f0-85e5-743206868e42 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:31.951874 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c51549b7-48f9-41f0-85e5-743206868e42 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:32.039029 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c51549b7-48f9-41f0-85e5-743206868e42 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:32.053383 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c51549b7-48f9-41f0-85e5-743206868e42 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1190 microversion: 2.1 time: 0.117090 Nov 02 16:53:32.055335 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 507/992] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:31 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1190 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:32.065980 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d9c44141-9cb9-4a16-b072-1d3244cf1d93 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:32.067277 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d9c44141-9cb9-4a16-b072-1d3244cf1d93 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:32.076568 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d9c44141-9cb9-4a16-b072-1d3244cf1d93 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:32.077275 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d9c44141-9cb9-4a16-b072-1d3244cf1d93 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:32.078430 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d9c44141-9cb9-4a16-b072-1d3244cf1d93 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:32.078978 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d9c44141-9cb9-4a16-b072-1d3244cf1d93 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:32.186069 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d9c44141-9cb9-4a16-b072-1d3244cf1d93 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 31635 microversion: 2.20 time: 0.124494 Nov 02 16:53:32.187128 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 486/993] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:32 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 31635 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:32.503367 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5091a110-edd9-484f-87c4-281e26643a40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:32.504200 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5091a110-edd9-484f-87c4-281e26643a40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:32.512743 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5091a110-edd9-484f-87c4-281e26643a40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:32.513213 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5091a110-edd9-484f-87c4-281e26643a40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:32.514051 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5091a110-edd9-484f-87c4-281e26643a40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:32.514511 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5091a110-edd9-484f-87c4-281e26643a40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:32.612565 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5091a110-edd9-484f-87c4-281e26643a40 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 17931 microversion: 2.1 time: 0.113370 Nov 02 16:53:32.618449 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 508/994] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:32 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 17931 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:33.075779 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4e0e4eb0-2304-4116-9236-144f38b41042 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:33.077373 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4e0e4eb0-2304-4116-9236-144f38b41042 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:33.086783 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4e0e4eb0-2304-4116-9236-144f38b41042 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:33.086783 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4e0e4eb0-2304-4116-9236-144f38b41042 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:33.087557 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4e0e4eb0-2304-4116-9236-144f38b41042 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:33.088502 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4e0e4eb0-2304-4116-9236-144f38b41042 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:33.202034 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-adcf94c2-1daf-4e41-abd2-26faa2d9dd82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:33.203237 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-adcf94c2-1daf-4e41-abd2-26faa2d9dd82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:33.212263 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-adcf94c2-1daf-4e41-abd2-26faa2d9dd82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:33.213346 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-adcf94c2-1daf-4e41-abd2-26faa2d9dd82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:33.214528 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-adcf94c2-1daf-4e41-abd2-26faa2d9dd82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:33.215068 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-adcf94c2-1daf-4e41-abd2-26faa2d9dd82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:33.311040 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-adcf94c2-1daf-4e41-abd2-26faa2d9dd82 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 32456 microversion: 2.20 time: 0.114585 Nov 02 16:53:33.316307 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 509/995] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:33 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 32456 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:33.394328 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4e0e4eb0-2304-4116-9236-144f38b41042 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:33.402942 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4e0e4eb0-2304-4116-9236-144f38b41042 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1264 microversion: 2.1 time: 0.331641 Nov 02 16:53:33.403604 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 487/996] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:33 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1264 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:53:33.630832 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-542d8f90-5bcf-4cab-b43b-64b14362912f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:33.632944 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-542d8f90-5bcf-4cab-b43b-64b14362912f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:33.643282 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-542d8f90-5bcf-4cab-b43b-64b14362912f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:33.643955 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-542d8f90-5bcf-4cab-b43b-64b14362912f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:33.645022 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-542d8f90-5bcf-4cab-b43b-64b14362912f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:33.645628 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-542d8f90-5bcf-4cab-b43b-64b14362912f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:33.761703 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-542d8f90-5bcf-4cab-b43b-64b14362912f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 19342 microversion: 2.1 time: 0.135885 Nov 02 16:53:33.763565 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 510/997] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:33 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 19342 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:33.821157 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-c98bb961-f707-41f9-a660-e237600b08e2 req-72abdf05-2d38-4f75-9858-6db47243b3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6e9f89-7228-463b-b906-679a99ec651c", "tag": "ade707f9-321b-475f-822b-2951865dc9c2"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:33.831003 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:53:33.831003 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:53:33.873147 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-c98bb961-f707-41f9-a660-e237600b08e2 req-72abdf05-2d38-4f75-9858-6db47243b3a6 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:33.873959 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-c98bb961-f707-41f9-a660-e237600b08e2 req-72abdf05-2d38-4f75-9858-6db47243b3a6 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:33.892971 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-c98bb961-f707-41f9-a660-e237600b08e2 req-72abdf05-2d38-4f75-9858-6db47243b3a6 service nova] Creating event network-changed:ade707f9-321b-475f-822b-2951865dc9c2 for instance fe6e9f89-7228-463b-b906-679a99ec651c on hv-cinder-77387 Nov 02 16:53:33.899726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-c98bb961-f707-41f9-a660-e237600b08e2 req-72abdf05-2d38-4f75-9858-6db47243b3a6 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087810 Nov 02 16:53:33.901106 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 488/998] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:53:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:53:34.330119 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-faa7bfc7-0ae8-42e4-87e6-ea7bcbc24093 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:34.332731 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-faa7bfc7-0ae8-42e4-87e6-ea7bcbc24093 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:34.341071 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-faa7bfc7-0ae8-42e4-87e6-ea7bcbc24093 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:34.341970 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-faa7bfc7-0ae8-42e4-87e6-ea7bcbc24093 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:34.343075 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-faa7bfc7-0ae8-42e4-87e6-ea7bcbc24093 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:34.343525 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-faa7bfc7-0ae8-42e4-87e6-ea7bcbc24093 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:34.422867 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a525ffe8-12da-473f-9bac-464addeb3308 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:34.423850 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a525ffe8-12da-473f-9bac-464addeb3308 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:34.434729 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a525ffe8-12da-473f-9bac-464addeb3308 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:34.435518 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a525ffe8-12da-473f-9bac-464addeb3308 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:34.436735 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a525ffe8-12da-473f-9bac-464addeb3308 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:34.437198 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a525ffe8-12da-473f-9bac-464addeb3308 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:34.472651 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-faa7bfc7-0ae8-42e4-87e6-ea7bcbc24093 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 33137 microversion: 2.20 time: 0.149946 Nov 02 16:53:34.474113 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 511/999] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:34 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 33137 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:34.706688 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a525ffe8-12da-473f-9bac-464addeb3308 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:34.723578 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a525ffe8-12da-473f-9bac-464addeb3308 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1264 microversion: 2.1 time: 0.305584 Nov 02 16:53:34.724868 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 489/1000] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:34 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1264 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:53:34.781595 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fc807608-b02c-42ca-86d5-9b20ea5da6e5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:34.783130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fc807608-b02c-42ca-86d5-9b20ea5da6e5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:34.794178 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc807608-b02c-42ca-86d5-9b20ea5da6e5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:34.794640 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc807608-b02c-42ca-86d5-9b20ea5da6e5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:34.795992 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc807608-b02c-42ca-86d5-9b20ea5da6e5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:34.796504 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc807608-b02c-42ca-86d5-9b20ea5da6e5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:34.917170 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fc807608-b02c-42ca-86d5-9b20ea5da6e5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 21288 microversion: 2.1 time: 0.144628 Nov 02 16:53:34.919112 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 512/1001] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:34 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 21288 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:35.487344 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f426fb50-f7b9-4138-9f8e-8ad038999d74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:35.488703 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f426fb50-f7b9-4138-9f8e-8ad038999d74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:35.496000 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f426fb50-f7b9-4138-9f8e-8ad038999d74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:35.496398 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f426fb50-f7b9-4138-9f8e-8ad038999d74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:35.497227 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f426fb50-f7b9-4138-9f8e-8ad038999d74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:35.497676 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f426fb50-f7b9-4138-9f8e-8ad038999d74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:35.591123 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f426fb50-f7b9-4138-9f8e-8ad038999d74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 33624 microversion: 2.20 time: 0.107900 Nov 02 16:53:35.591901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 490/1002] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:35 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 33624 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:35.753302 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-66ffc5f5-70ce-4411-91c9-f41d1ac886a0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:35.754023 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-66ffc5f5-70ce-4411-91c9-f41d1ac886a0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:35.763814 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-66ffc5f5-70ce-4411-91c9-f41d1ac886a0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:35.764315 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-66ffc5f5-70ce-4411-91c9-f41d1ac886a0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:35.765179 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-66ffc5f5-70ce-4411-91c9-f41d1ac886a0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:35.765625 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-66ffc5f5-70ce-4411-91c9-f41d1ac886a0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:35.927397 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-66ffc5f5-70ce-4411-91c9-f41d1ac886a0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:35.932967 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e4205171-7586-430b-9200-b9360f395d42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:35.934104 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e4205171-7586-430b-9200-b9360f395d42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:35.936918 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-66ffc5f5-70ce-4411-91c9-f41d1ac886a0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1264 microversion: 2.1 time: 0.188757 Nov 02 16:53:35.937572 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 513/1003] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:35 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:35.942315 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4205171-7586-430b-9200-b9360f395d42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:35.942788 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4205171-7586-430b-9200-b9360f395d42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:35.943623 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4205171-7586-430b-9200-b9360f395d42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:35.944141 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4205171-7586-430b-9200-b9360f395d42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:36.058209 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e4205171-7586-430b-9200-b9360f395d42 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 22891 microversion: 2.1 time: 0.131025 Nov 02 16:53:36.059058 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 491/1004] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:35 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 22891 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:53:36.604849 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-96e05313-2956-478e-a266-0805adfbce74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:36.605850 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-96e05313-2956-478e-a266-0805adfbce74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:36.613611 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-96e05313-2956-478e-a266-0805adfbce74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:36.614074 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-96e05313-2956-478e-a266-0805adfbce74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:36.614895 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-96e05313-2956-478e-a266-0805adfbce74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:36.615344 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-96e05313-2956-478e-a266-0805adfbce74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:36.717141 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-96e05313-2956-478e-a266-0805adfbce74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 34288 microversion: 2.20 time: 0.116386 Nov 02 16:53:36.718298 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 514/1005] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:36 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 34288 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:36.956654 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3a9646cb-e447-42f0-87a9-8755f55de79f tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:36.957444 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3a9646cb-e447-42f0-87a9-8755f55de79f tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:36.965841 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a9646cb-e447-42f0-87a9-8755f55de79f tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:36.966302 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a9646cb-e447-42f0-87a9-8755f55de79f tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:36.967192 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a9646cb-e447-42f0-87a9-8755f55de79f tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:36.967587 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a9646cb-e447-42f0-87a9-8755f55de79f tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:37.074015 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f47f9aae-b7c1-4ed9-9409-271a0e17d7cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:37.075121 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f47f9aae-b7c1-4ed9-9409-271a0e17d7cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:37.083212 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f47f9aae-b7c1-4ed9-9409-271a0e17d7cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:37.083683 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f47f9aae-b7c1-4ed9-9409-271a0e17d7cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:37.084539 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f47f9aae-b7c1-4ed9-9409-271a0e17d7cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:37.085288 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f47f9aae-b7c1-4ed9-9409-271a0e17d7cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:37.127796 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3a9646cb-e447-42f0-87a9-8755f55de79f tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:37.138379 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3a9646cb-e447-42f0-87a9-8755f55de79f tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1264 microversion: 2.1 time: 0.186468 Nov 02 16:53:37.139032 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 492/1006] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:36 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:37.183844 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f47f9aae-b7c1-4ed9-9409-271a0e17d7cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 23798 microversion: 2.1 time: 0.115719 Nov 02 16:53:37.184653 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 515/1007] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:37 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 23798 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:37.731575 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b7ee3cb1-2c46-4e98-a33b-6e2be9abdd42 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:37.732624 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b7ee3cb1-2c46-4e98-a33b-6e2be9abdd42 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:37.739973 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b7ee3cb1-2c46-4e98-a33b-6e2be9abdd42 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:37.740476 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b7ee3cb1-2c46-4e98-a33b-6e2be9abdd42 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:37.742025 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b7ee3cb1-2c46-4e98-a33b-6e2be9abdd42 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:37.742679 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b7ee3cb1-2c46-4e98-a33b-6e2be9abdd42 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:37.854266 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b7ee3cb1-2c46-4e98-a33b-6e2be9abdd42 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 35106 microversion: 2.20 time: 0.126948 Nov 02 16:53:37.855014 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 493/1008] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:37 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 35106 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:38.158092 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-befc3906-008d-4e6b-91b8-e1a7aa765cea tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:38.158801 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-befc3906-008d-4e6b-91b8-e1a7aa765cea tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:38.167742 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-befc3906-008d-4e6b-91b8-e1a7aa765cea tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:38.168234 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-befc3906-008d-4e6b-91b8-e1a7aa765cea tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:38.169060 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-befc3906-008d-4e6b-91b8-e1a7aa765cea tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:38.169513 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-befc3906-008d-4e6b-91b8-e1a7aa765cea tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:38.197914 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d3a45a3c-abf0-4e78-894b-c11c2e9dafc3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:38.199079 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d3a45a3c-abf0-4e78-894b-c11c2e9dafc3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:38.208215 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d3a45a3c-abf0-4e78-894b-c11c2e9dafc3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:38.208696 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d3a45a3c-abf0-4e78-894b-c11c2e9dafc3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:38.209557 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d3a45a3c-abf0-4e78-894b-c11c2e9dafc3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:38.210050 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d3a45a3c-abf0-4e78-894b-c11c2e9dafc3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:38.303487 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d3a45a3c-abf0-4e78-894b-c11c2e9dafc3 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 24601 microversion: 2.1 time: 0.109958 Nov 02 16:53:38.307987 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 494/1009] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:38 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 24601 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:53:38.329853 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-befc3906-008d-4e6b-91b8-e1a7aa765cea tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:38.340276 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-befc3906-008d-4e6b-91b8-e1a7aa765cea tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1264 microversion: 2.1 time: 0.186824 Nov 02 16:53:38.341099 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 516/1010] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:38 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:38.867435 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e378af09-d34f-4369-8bf8-67384930a9a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:38.868556 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e378af09-d34f-4369-8bf8-67384930a9a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:38.876527 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e378af09-d34f-4369-8bf8-67384930a9a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:38.877028 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e378af09-d34f-4369-8bf8-67384930a9a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:38.877844 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e378af09-d34f-4369-8bf8-67384930a9a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:38.878292 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e378af09-d34f-4369-8bf8-67384930a9a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:38.973425 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e378af09-d34f-4369-8bf8-67384930a9a4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 35972 microversion: 2.20 time: 0.110346 Nov 02 16:53:38.974179 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 495/1011] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:38 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 35972 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:39.318849 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6c8abec2-931b-48be-b09d-5829d3dd38c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:39.320576 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6c8abec2-931b-48be-b09d-5829d3dd38c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:39.328623 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6c8abec2-931b-48be-b09d-5829d3dd38c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:39.329126 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6c8abec2-931b-48be-b09d-5829d3dd38c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:39.329961 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6c8abec2-931b-48be-b09d-5829d3dd38c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:39.330410 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6c8abec2-931b-48be-b09d-5829d3dd38c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:39.359886 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-065506a1-8942-4363-a8d6-ff5fde21cf1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:39.360745 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-065506a1-8942-4363-a8d6-ff5fde21cf1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:39.370318 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-065506a1-8942-4363-a8d6-ff5fde21cf1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:39.370777 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-065506a1-8942-4363-a8d6-ff5fde21cf1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:39.371608 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-065506a1-8942-4363-a8d6-ff5fde21cf1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:39.372046 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-065506a1-8942-4363-a8d6-ff5fde21cf1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:39.435634 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6c8abec2-931b-48be-b09d-5829d3dd38c4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 25655 microversion: 2.1 time: 0.122794 Nov 02 16:53:39.436524 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 517/1012] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:39 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 25655 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:39.533512 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-065506a1-8942-4363-a8d6-ff5fde21cf1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:39.543484 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-065506a1-8942-4363-a8d6-ff5fde21cf1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1264 microversion: 2.1 time: 0.188038 Nov 02 16:53:39.544145 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 496/1013] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:39 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:53:39.987947 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-56afae79-5008-4365-b7f5-a16079a9cbcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:39.989081 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-56afae79-5008-4365-b7f5-a16079a9cbcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:39.998999 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-56afae79-5008-4365-b7f5-a16079a9cbcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:39.999463 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-56afae79-5008-4365-b7f5-a16079a9cbcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:40.000341 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-56afae79-5008-4365-b7f5-a16079a9cbcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:40.000794 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-56afae79-5008-4365-b7f5-a16079a9cbcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:40.104241 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-56afae79-5008-4365-b7f5-a16079a9cbcb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 37003 microversion: 2.20 time: 0.120605 Nov 02 16:53:40.104988 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 518/1014] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:39 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 37003 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:40.452569 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a0117e94-fad7-411d-a426-193c97e6c8b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:40.453887 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a0117e94-fad7-411d-a426-193c97e6c8b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:40.462446 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0117e94-fad7-411d-a426-193c97e6c8b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:40.462905 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0117e94-fad7-411d-a426-193c97e6c8b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:40.463799 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0117e94-fad7-411d-a426-193c97e6c8b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:40.464292 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0117e94-fad7-411d-a426-193c97e6c8b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:40.558576 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a0117e94-fad7-411d-a426-193c97e6c8b8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 26359 microversion: 2.1 time: 0.113070 Nov 02 16:53:40.559633 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 497/1015] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:40 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 26359 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:53:40.562359 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-dc56794c-2eb9-48b3-a0e3-c81cc7b23cd3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:40.563140 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-dc56794c-2eb9-48b3-a0e3-c81cc7b23cd3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:40.572243 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dc56794c-2eb9-48b3-a0e3-c81cc7b23cd3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:40.572728 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dc56794c-2eb9-48b3-a0e3-c81cc7b23cd3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:40.573566 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dc56794c-2eb9-48b3-a0e3-c81cc7b23cd3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:40.574020 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dc56794c-2eb9-48b3-a0e3-c81cc7b23cd3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:40.730606 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-dc56794c-2eb9-48b3-a0e3-c81cc7b23cd3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:40.739103 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-dc56794c-2eb9-48b3-a0e3-c81cc7b23cd3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1264 microversion: 2.1 time: 0.181590 Nov 02 16:53:40.739739 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 519/1016] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:40 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:41.119004 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-871cf97b-ed07-4514-b88f-92cf4bd2595a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:41.120245 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-871cf97b-ed07-4514-b88f-92cf4bd2595a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:41.128799 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-871cf97b-ed07-4514-b88f-92cf4bd2595a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:41.129275 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-871cf97b-ed07-4514-b88f-92cf4bd2595a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:41.130102 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-871cf97b-ed07-4514-b88f-92cf4bd2595a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:41.130671 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-871cf97b-ed07-4514-b88f-92cf4bd2595a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:41.234796 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-871cf97b-ed07-4514-b88f-92cf4bd2595a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 37833 microversion: 2.20 time: 0.119646 Nov 02 16:53:41.236641 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 498/1017] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:41 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 37833 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:41.575186 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-18e8bd1f-fd5b-433f-9362-6b186339d0f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:41.576225 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-18e8bd1f-fd5b-433f-9362-6b186339d0f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:41.584256 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-18e8bd1f-fd5b-433f-9362-6b186339d0f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:41.585633 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-18e8bd1f-fd5b-433f-9362-6b186339d0f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:41.586305 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-18e8bd1f-fd5b-433f-9362-6b186339d0f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:41.586756 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-18e8bd1f-fd5b-433f-9362-6b186339d0f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:41.697211 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-18e8bd1f-fd5b-433f-9362-6b186339d0f4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 27040 microversion: 2.1 time: 0.128954 Nov 02 16:53:41.698066 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 520/1018] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:41 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 27040 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:41.759302 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-69971f16-4f6f-40f3-b6a8-f3c69a3d832a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:41.760078 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-69971f16-4f6f-40f3-b6a8-f3c69a3d832a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:41.769467 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-69971f16-4f6f-40f3-b6a8-f3c69a3d832a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:41.770040 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-69971f16-4f6f-40f3-b6a8-f3c69a3d832a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:41.770871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-69971f16-4f6f-40f3-b6a8-f3c69a3d832a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:41.771323 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-69971f16-4f6f-40f3-b6a8-f3c69a3d832a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:41.942354 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-69971f16-4f6f-40f3-b6a8-f3c69a3d832a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:41.952567 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-69971f16-4f6f-40f3-b6a8-f3c69a3d832a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1264 microversion: 2.1 time: 0.197596 Nov 02 16:53:41.953244 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 499/1019] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:41 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:42.251475 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a98e5dbb-e1d8-409f-b676-ea7b09adf73b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:42.252589 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a98e5dbb-e1d8-409f-b676-ea7b09adf73b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:42.262358 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a98e5dbb-e1d8-409f-b676-ea7b09adf73b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:42.262897 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a98e5dbb-e1d8-409f-b676-ea7b09adf73b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:42.263757 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a98e5dbb-e1d8-409f-b676-ea7b09adf73b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:42.264433 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a98e5dbb-e1d8-409f-b676-ea7b09adf73b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:42.366321 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a98e5dbb-e1d8-409f-b676-ea7b09adf73b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 38178 microversion: 2.20 time: 0.118618 Nov 02 16:53:42.367249 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 521/1020] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:42 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 38178 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:42.710910 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4cd38e1c-8f00-48bf-b93e-34d73a556f0b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:42.711998 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4cd38e1c-8f00-48bf-b93e-34d73a556f0b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:42.719462 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4cd38e1c-8f00-48bf-b93e-34d73a556f0b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:42.719931 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4cd38e1c-8f00-48bf-b93e-34d73a556f0b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:42.720803 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4cd38e1c-8f00-48bf-b93e-34d73a556f0b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:42.721260 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4cd38e1c-8f00-48bf-b93e-34d73a556f0b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:42.824701 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4cd38e1c-8f00-48bf-b93e-34d73a556f0b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 27518 microversion: 2.1 time: 0.118375 Nov 02 16:53:42.825887 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 500/1021] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:42 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 27518 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:42.972729 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1c832552-fe47-45cb-b56b-b4aff612f77b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:42.973830 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1c832552-fe47-45cb-b56b-b4aff612f77b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:42.982351 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1c832552-fe47-45cb-b56b-b4aff612f77b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:42.982818 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1c832552-fe47-45cb-b56b-b4aff612f77b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:42.983657 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1c832552-fe47-45cb-b56b-b4aff612f77b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:42.984105 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1c832552-fe47-45cb-b56b-b4aff612f77b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:43.144704 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1c832552-fe47-45cb-b56b-b4aff612f77b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:43.157052 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1c832552-fe47-45cb-b56b-b4aff612f77b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1264 microversion: 2.1 time: 0.189401 Nov 02 16:53:43.157714 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 522/1022] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:42 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:43.381098 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b771f1dc-921d-488f-b189-565fc29a1c00 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:43.382181 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b771f1dc-921d-488f-b189-565fc29a1c00 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:43.390654 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b771f1dc-921d-488f-b189-565fc29a1c00 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:43.391123 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b771f1dc-921d-488f-b189-565fc29a1c00 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:43.391954 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b771f1dc-921d-488f-b189-565fc29a1c00 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:43.392443 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b771f1dc-921d-488f-b189-565fc29a1c00 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:43.471811 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b771f1dc-921d-488f-b189-565fc29a1c00 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 38178 microversion: 2.20 time: 0.095064 Nov 02 16:53:43.472608 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 501/1023] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:43 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 38178 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:43.838003 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c7adbf14-60ed-4303-ae21-64805be49afb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:43.839023 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c7adbf14-60ed-4303-ae21-64805be49afb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:43.846829 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c7adbf14-60ed-4303-ae21-64805be49afb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:43.847398 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c7adbf14-60ed-4303-ae21-64805be49afb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:43.848119 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c7adbf14-60ed-4303-ae21-64805be49afb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:43.848609 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c7adbf14-60ed-4303-ae21-64805be49afb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:43.958498 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c7adbf14-60ed-4303-ae21-64805be49afb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 27823 microversion: 2.1 time: 0.124749 Nov 02 16:53:43.958966 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 523/1024] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:43 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 27823 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:44.175854 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1649381d-351f-4e6a-8729-e14d2b40fa55 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:44.176832 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1649381d-351f-4e6a-8729-e14d2b40fa55 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:44.185934 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1649381d-351f-4e6a-8729-e14d2b40fa55 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:44.186432 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1649381d-351f-4e6a-8729-e14d2b40fa55 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:44.187257 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1649381d-351f-4e6a-8729-e14d2b40fa55 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:44.187709 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1649381d-351f-4e6a-8729-e14d2b40fa55 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:44.341654 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1649381d-351f-4e6a-8729-e14d2b40fa55 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:44.355778 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1649381d-351f-4e6a-8729-e14d2b40fa55 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1264 microversion: 2.1 time: 0.184291 Nov 02 16:53:44.356471 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 502/1025] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:44 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:44.488234 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2500d4f4-58c5-4b5c-b8e1-31c4b629b835 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:44.489124 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2500d4f4-58c5-4b5c-b8e1-31c4b629b835 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:44.497042 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2500d4f4-58c5-4b5c-b8e1-31c4b629b835 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:44.497582 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2500d4f4-58c5-4b5c-b8e1-31c4b629b835 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:44.498317 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2500d4f4-58c5-4b5c-b8e1-31c4b629b835 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:44.499014 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2500d4f4-58c5-4b5c-b8e1-31c4b629b835 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:44.588439 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2500d4f4-58c5-4b5c-b8e1-31c4b629b835 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 200 len: 38319 microversion: 2.20 time: 0.105042 Nov 02 16:53:44.590893 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 524/1026] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:44 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 38319 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:53:44.601776 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-84be77b1-51b5-4517-8c05-44b133c7214d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:44.602444 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-84be77b1-51b5-4517-8c05-44b133c7214d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:44.611463 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-84be77b1-51b5-4517-8c05-44b133c7214d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:44.611463 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-84be77b1-51b5-4517-8c05-44b133c7214d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:44.612549 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-84be77b1-51b5-4517-8c05-44b133c7214d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:44.613094 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-84be77b1-51b5-4517-8c05-44b133c7214d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:44.644099 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-84be77b1-51b5-4517-8c05-44b133c7214d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/ips" status: 200 len: 153 microversion: 2.20 time: 0.047737 Nov 02 16:53:44.644796 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 503/1027] 10.222.0.118 () {60 vars in 1293 bytes} [Tue Nov 2 16:53:44 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/ips => generated 153 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:44.972869 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-907bd5eb-806e-4ffa-a9e4-b6507f2a8f9d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:44.973957 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-907bd5eb-806e-4ffa-a9e4-b6507f2a8f9d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:44.982502 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-907bd5eb-806e-4ffa-a9e4-b6507f2a8f9d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:44.982973 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-907bd5eb-806e-4ffa-a9e4-b6507f2a8f9d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:44.984103 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-907bd5eb-806e-4ffa-a9e4-b6507f2a8f9d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:44.984604 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-907bd5eb-806e-4ffa-a9e4-b6507f2a8f9d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:45.090107 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-907bd5eb-806e-4ffa-a9e4-b6507f2a8f9d tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 28021 microversion: 2.1 time: 0.121825 Nov 02 16:53:45.091250 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 525/1028] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:44 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 28021 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:45.374044 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d194a49f-6144-487c-b837-3a395ed0e326 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:45.374835 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d194a49f-6144-487c-b837-3a395ed0e326 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:45.382339 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d194a49f-6144-487c-b837-3a395ed0e326 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:45.382805 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d194a49f-6144-487c-b837-3a395ed0e326 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:45.383621 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d194a49f-6144-487c-b837-3a395ed0e326 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:45.384068 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d194a49f-6144-487c-b837-3a395ed0e326 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:45.528816 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d194a49f-6144-487c-b837-3a395ed0e326 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:45.537199 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d194a49f-6144-487c-b837-3a395ed0e326 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1264 microversion: 2.1 time: 0.167637 Nov 02 16:53:45.538433 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 504/1029] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:45 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:45.993901 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-23d530ac-0545-4bf8-8220-e9e10322b504 req-e3bc6d21-2d39-4a11-9d58-4cfd01bf0230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6e9f89-7228-463b-b906-679a99ec651c", "name": "network-vif-plugged", "status": "completed", "tag": "ade707f9-321b-475f-822b-2951865dc9c2"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:45.995615 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:53:45.995615 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:53:46.011790 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-23d530ac-0545-4bf8-8220-e9e10322b504 req-e3bc6d21-2d39-4a11-9d58-4cfd01bf0230 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:46.012282 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-23d530ac-0545-4bf8-8220-e9e10322b504 req-e3bc6d21-2d39-4a11-9d58-4cfd01bf0230 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:46.031528 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-23d530ac-0545-4bf8-8220-e9e10322b504 req-e3bc6d21-2d39-4a11-9d58-4cfd01bf0230 service nova] Creating event network-vif-plugged:ade707f9-321b-475f-822b-2951865dc9c2 for instance fe6e9f89-7228-463b-b906-679a99ec651c on hv-cinder-77387 Nov 02 16:53:46.038640 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-23d530ac-0545-4bf8-8220-e9e10322b504 req-e3bc6d21-2d39-4a11-9d58-4cfd01bf0230 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051531 Nov 02 16:53:46.039346 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 526/1030] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:53:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:53:46.103612 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-bf35514b-a322-4239-82ed-c7eecc0140e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:46.105280 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-bf35514b-a322-4239-82ed-c7eecc0140e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:46.113570 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bf35514b-a322-4239-82ed-c7eecc0140e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:46.113930 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bf35514b-a322-4239-82ed-c7eecc0140e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:46.114987 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bf35514b-a322-4239-82ed-c7eecc0140e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:46.116308 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bf35514b-a322-4239-82ed-c7eecc0140e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:46.221999 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-bf35514b-a322-4239-82ed-c7eecc0140e2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 28190 microversion: 2.1 time: 0.121485 Nov 02 16:53:46.223444 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 505/1031] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:46 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 28190 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:46.557280 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-589e02d1-dc45-4f77-8d7e-ade0cfe8ec56 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:46.558017 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-589e02d1-dc45-4f77-8d7e-ade0cfe8ec56 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:46.564932 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-589e02d1-dc45-4f77-8d7e-ade0cfe8ec56 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:46.565392 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-589e02d1-dc45-4f77-8d7e-ade0cfe8ec56 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:46.566186 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-589e02d1-dc45-4f77-8d7e-ade0cfe8ec56 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:46.566630 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-589e02d1-dc45-4f77-8d7e-ade0cfe8ec56 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:46.715382 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-589e02d1-dc45-4f77-8d7e-ade0cfe8ec56 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:46.723531 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-589e02d1-dc45-4f77-8d7e-ade0cfe8ec56 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1264 microversion: 2.1 time: 0.171989 Nov 02 16:53:46.724164 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 527/1032] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:46 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:46.921873 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c93a7180-ce94-485b-a6b2-0330881a2968 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:46.922569 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c93a7180-ce94-485b-a6b2-0330881a2968 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:46.930778 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c93a7180-ce94-485b-a6b2-0330881a2968 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:46.931237 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c93a7180-ce94-485b-a6b2-0330881a2968 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:46.932042 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c93a7180-ce94-485b-a6b2-0330881a2968 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:46.932546 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c93a7180-ce94-485b-a6b2-0330881a2968 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:46.957830 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.objects.instance [None req-c93a7180-ce94-485b-a6b2-0330881a2968 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lazy-loading 'flavor' on Instance uuid 886e9a36-a4f8-44ed-80d0-6a440f49e430 {{(pid=127648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:53:47.228053 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c93a7180-ce94-485b-a6b2-0330881a2968 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 202 len: 0 microversion: 2.20 time: 0.310687 Nov 02 16:53:47.228970 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 506/1033] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:53:46 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:53:47.235865 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-d7a61f11-7c42-4aeb-90c4-a25832f15ade tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:47.236911 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d7a61f11-7c42-4aeb-90c4-a25832f15ade tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:47.241309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7d97afb0-09ed-4015-a30d-5b8ea8784090 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:47.241309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7d97afb0-09ed-4015-a30d-5b8ea8784090 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:47.247829 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7d97afb0-09ed-4015-a30d-5b8ea8784090 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:47.248086 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d7a61f11-7c42-4aeb-90c4-a25832f15ade tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:47.248346 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d7a61f11-7c42-4aeb-90c4-a25832f15ade tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:47.248508 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7d97afb0-09ed-4015-a30d-5b8ea8784090 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:47.249262 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7d97afb0-09ed-4015-a30d-5b8ea8784090 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:47.249406 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d7a61f11-7c42-4aeb-90c4-a25832f15ade tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:47.249713 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7d97afb0-09ed-4015-a30d-5b8ea8784090 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:47.249887 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d7a61f11-7c42-4aeb-90c4-a25832f15ade tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:47.332869 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-d7a61f11-7c42-4aeb-90c4-a25832f15ade tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 28190 microversion: 2.1 time: 0.100942 Nov 02 16:53:47.333678 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 528/1034] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:47 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 28190 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:47.414154 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7d97afb0-09ed-4015-a30d-5b8ea8784090 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:47.423597 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7d97afb0-09ed-4015-a30d-5b8ea8784090 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:47.425242 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7d97afb0-09ed-4015-a30d-5b8ea8784090 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:47.426511 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7d97afb0-09ed-4015-a30d-5b8ea8784090 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.193292 Nov 02 16:53:47.427138 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 507/1035] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:53:47 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:53:47.743549 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0861d73c-5db1-4ecd-8967-553f870d2d82 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:47.744336 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0861d73c-5db1-4ecd-8967-553f870d2d82 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:47.756603 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0861d73c-5db1-4ecd-8967-553f870d2d82 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:47.757113 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0861d73c-5db1-4ecd-8967-553f870d2d82 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:47.758220 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0861d73c-5db1-4ecd-8967-553f870d2d82 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:47.758835 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0861d73c-5db1-4ecd-8967-553f870d2d82 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:47.932138 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0861d73c-5db1-4ecd-8967-553f870d2d82 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:47.940921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0861d73c-5db1-4ecd-8967-553f870d2d82 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1264 microversion: 2.1 time: 0.202683 Nov 02 16:53:47.941580 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 529/1036] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:47 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:48.346532 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d814b240-fa71-4dff-b16b-caeeb20b684a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:48.347623 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d814b240-fa71-4dff-b16b-caeeb20b684a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:48.355838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d814b240-fa71-4dff-b16b-caeeb20b684a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:48.356334 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d814b240-fa71-4dff-b16b-caeeb20b684a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:48.357150 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d814b240-fa71-4dff-b16b-caeeb20b684a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:48.357592 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d814b240-fa71-4dff-b16b-caeeb20b684a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:48.447127 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-12f6c470-39b7-4714-8000-5f795b1fd91e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:48.447884 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-12f6c470-39b7-4714-8000-5f795b1fd91e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:48.455296 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-12f6c470-39b7-4714-8000-5f795b1fd91e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:48.455773 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-12f6c470-39b7-4714-8000-5f795b1fd91e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:48.456646 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-12f6c470-39b7-4714-8000-5f795b1fd91e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:48.457097 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-12f6c470-39b7-4714-8000-5f795b1fd91e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:48.464901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d814b240-fa71-4dff-b16b-caeeb20b684a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 28481 microversion: 2.1 time: 0.122111 Nov 02 16:53:48.465673 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 508/1037] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:48 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 28481 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:48.614148 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-12f6c470-39b7-4714-8000-5f795b1fd91e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:48.623285 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-12f6c470-39b7-4714-8000-5f795b1fd91e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:48.624969 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-12f6c470-39b7-4714-8000-5f795b1fd91e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:48.626248 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-12f6c470-39b7-4714-8000-5f795b1fd91e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.183520 Nov 02 16:53:48.626884 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 530/1038] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:53:48 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:53:48.960907 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9e7c2fb4-bae8-4630-8a83-f3087248afc2 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:48.961673 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9e7c2fb4-bae8-4630-8a83-f3087248afc2 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:48.969809 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e7c2fb4-bae8-4630-8a83-f3087248afc2 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:48.970278 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e7c2fb4-bae8-4630-8a83-f3087248afc2 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:48.971107 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e7c2fb4-bae8-4630-8a83-f3087248afc2 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:48.971554 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9e7c2fb4-bae8-4630-8a83-f3087248afc2 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:49.130818 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9e7c2fb4-bae8-4630-8a83-f3087248afc2 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:49.140635 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9e7c2fb4-bae8-4630-8a83-f3087248afc2 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1447 microversion: 2.1 time: 0.184850 Nov 02 16:53:49.141278 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 509/1039] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:48 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:49.159208 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-acb8b8d6-4a29-4064-8a42-1187547cd3f9 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:49.159921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-acb8b8d6-4a29-4064-8a42-1187547cd3f9 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:49.168232 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-acb8b8d6-4a29-4064-8a42-1187547cd3f9 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:49.168706 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-acb8b8d6-4a29-4064-8a42-1187547cd3f9 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:49.169534 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-acb8b8d6-4a29-4064-8a42-1187547cd3f9 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:49.169985 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-acb8b8d6-4a29-4064-8a42-1187547cd3f9 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:49.319724 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-acb8b8d6-4a29-4064-8a42-1187547cd3f9 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:49.329057 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-acb8b8d6-4a29-4064-8a42-1187547cd3f9 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1447 microversion: 2.1 time: 0.173775 Nov 02 16:53:49.330076 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 531/1040] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:53:49 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:53:49.477920 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a69fff99-bbf4-413e-a83e-4eb6810c096f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:49.478988 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a69fff99-bbf4-413e-a83e-4eb6810c096f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:49.486831 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a69fff99-bbf4-413e-a83e-4eb6810c096f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:49.487308 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a69fff99-bbf4-413e-a83e-4eb6810c096f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:49.488304 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a69fff99-bbf4-413e-a83e-4eb6810c096f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:49.488763 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a69fff99-bbf4-413e-a83e-4eb6810c096f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:49.582831 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a69fff99-bbf4-413e-a83e-4eb6810c096f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 28607 microversion: 2.1 time: 0.109145 Nov 02 16:53:49.583603 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 510/1041] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:49 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 28607 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:49.648982 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6b2b93d8-735c-46fa-9aa3-982c7d08b382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:49.649723 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6b2b93d8-735c-46fa-9aa3-982c7d08b382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:49.656944 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6b2b93d8-735c-46fa-9aa3-982c7d08b382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:49.657415 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6b2b93d8-735c-46fa-9aa3-982c7d08b382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:49.658239 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6b2b93d8-735c-46fa-9aa3-982c7d08b382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:49.658873 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6b2b93d8-735c-46fa-9aa3-982c7d08b382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:49.917291 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6b2b93d8-735c-46fa-9aa3-982c7d08b382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:49.927556 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6b2b93d8-735c-46fa-9aa3-982c7d08b382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:49.929844 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6b2b93d8-735c-46fa-9aa3-982c7d08b382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:49.931153 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6b2b93d8-735c-46fa-9aa3-982c7d08b382 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.287810 Nov 02 16:53:49.931796 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 532/1042] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:53:49 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:53:50.596711 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5b7036f8-4390-4010-9629-2169c95964ad tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:50.598056 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5b7036f8-4390-4010-9629-2169c95964ad tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:50.606040 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5b7036f8-4390-4010-9629-2169c95964ad tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:50.606503 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5b7036f8-4390-4010-9629-2169c95964ad tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:50.607327 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5b7036f8-4390-4010-9629-2169c95964ad tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:50.607810 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5b7036f8-4390-4010-9629-2169c95964ad tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:50.703386 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5b7036f8-4390-4010-9629-2169c95964ad tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 28649 microversion: 2.1 time: 0.110973 Nov 02 16:53:50.704199 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 511/1043] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:50 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 28649 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:50.953899 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a0b8c0ae-5650-4bf1-8462-cf4db1991bed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:50.954834 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a0b8c0ae-5650-4bf1-8462-cf4db1991bed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:50.963733 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0b8c0ae-5650-4bf1-8462-cf4db1991bed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:50.964069 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0b8c0ae-5650-4bf1-8462-cf4db1991bed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:50.964996 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0b8c0ae-5650-4bf1-8462-cf4db1991bed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:50.965445 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a0b8c0ae-5650-4bf1-8462-cf4db1991bed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:51.206167 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a0b8c0ae-5650-4bf1-8462-cf4db1991bed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:51.216319 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a0b8c0ae-5650-4bf1-8462-cf4db1991bed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:51.217801 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a0b8c0ae-5650-4bf1-8462-cf4db1991bed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:51.219056 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a0b8c0ae-5650-4bf1-8462-cf4db1991bed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.270173 Nov 02 16:53:51.219686 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 533/1044] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:53:50 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:53:51.391059 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-a5a7c5c1-1c50-4d09-9696-643f31f82375 req-f144f29d-7c8a-4491-8820-cf236eb29ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6e9f89-7228-463b-b906-679a99ec651c", "tag": "ade707f9-321b-475f-822b-2951865dc9c2"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:51.393162 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:53:51.393162 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:53:51.402673 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-a5a7c5c1-1c50-4d09-9696-643f31f82375 req-f144f29d-7c8a-4491-8820-cf236eb29ecc service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:51.403147 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-a5a7c5c1-1c50-4d09-9696-643f31f82375 req-f144f29d-7c8a-4491-8820-cf236eb29ecc service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:51.415673 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-a5a7c5c1-1c50-4d09-9696-643f31f82375 req-f144f29d-7c8a-4491-8820-cf236eb29ecc service nova] Creating event network-changed:ade707f9-321b-475f-822b-2951865dc9c2 for instance fe6e9f89-7228-463b-b906-679a99ec651c on hv-cinder-77387 Nov 02 16:53:51.421005 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-a5a7c5c1-1c50-4d09-9696-643f31f82375 req-f144f29d-7c8a-4491-8820-cf236eb29ecc service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034617 Nov 02 16:53:51.421941 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 512/1045] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:53:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:53:51.718958 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1a57fd20-fef7-43f7-a439-db34c8a8c14a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:51.720315 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1a57fd20-fef7-43f7-a439-db34c8a8c14a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:51.727643 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a57fd20-fef7-43f7-a439-db34c8a8c14a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:51.728012 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a57fd20-fef7-43f7-a439-db34c8a8c14a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:51.729077 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a57fd20-fef7-43f7-a439-db34c8a8c14a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:51.729515 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a57fd20-fef7-43f7-a439-db34c8a8c14a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:51.797978 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1a57fd20-fef7-43f7-a439-db34c8a8c14a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 28649 microversion: 2.1 time: 0.082922 Nov 02 16:53:51.802478 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 534/1046] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:51 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 28649 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:52.240132 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9d33635b-0d2a-4e27-b0d3-9f881c18cbe9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:52.242221 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9d33635b-0d2a-4e27-b0d3-9f881c18cbe9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:52.249589 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9d33635b-0d2a-4e27-b0d3-9f881c18cbe9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:52.250064 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9d33635b-0d2a-4e27-b0d3-9f881c18cbe9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:52.250894 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9d33635b-0d2a-4e27-b0d3-9f881c18cbe9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:52.251350 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9d33635b-0d2a-4e27-b0d3-9f881c18cbe9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:52.404717 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9d33635b-0d2a-4e27-b0d3-9f881c18cbe9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:52.414827 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9d33635b-0d2a-4e27-b0d3-9f881c18cbe9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:52.416460 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9d33635b-0d2a-4e27-b0d3-9f881c18cbe9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:52.417762 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9d33635b-0d2a-4e27-b0d3-9f881c18cbe9 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.182842 Nov 02 16:53:52.418852 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 513/1047] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:53:52 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:53:52.811557 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f3181591-3bd0-4bcd-885f-bc0645efadd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:52.812673 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f3181591-3bd0-4bcd-885f-bc0645efadd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:52.821319 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f3181591-3bd0-4bcd-885f-bc0645efadd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:52.821780 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f3181591-3bd0-4bcd-885f-bc0645efadd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:52.822584 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f3181591-3bd0-4bcd-885f-bc0645efadd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:52.823291 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f3181591-3bd0-4bcd-885f-bc0645efadd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:52.889944 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f3181591-3bd0-4bcd-885f-bc0645efadd6 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 28649 microversion: 2.1 time: 0.082541 Nov 02 16:53:52.890596 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 535/1048] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:52 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 28649 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:53.437406 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-83e90040-10cc-409a-8102-0c4ef28f97b0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:53.438142 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-83e90040-10cc-409a-8102-0c4ef28f97b0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:53.445445 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-83e90040-10cc-409a-8102-0c4ef28f97b0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:53.445905 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-83e90040-10cc-409a-8102-0c4ef28f97b0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:53.446704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-83e90040-10cc-409a-8102-0c4ef28f97b0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:53.447248 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-83e90040-10cc-409a-8102-0c4ef28f97b0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:53.596634 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-83e90040-10cc-409a-8102-0c4ef28f97b0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:53.606057 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-83e90040-10cc-409a-8102-0c4ef28f97b0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:53.607647 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-83e90040-10cc-409a-8102-0c4ef28f97b0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:53.608914 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-83e90040-10cc-409a-8102-0c4ef28f97b0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.175928 Nov 02 16:53:53.609543 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 514/1049] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:53:53 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:53:53.904489 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-57da5ae1-4f4c-49cd-a08e-00d3c7bed81f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:53.905445 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-57da5ae1-4f4c-49cd-a08e-00d3c7bed81f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:53.913333 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-57da5ae1-4f4c-49cd-a08e-00d3c7bed81f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:53.913792 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-57da5ae1-4f4c-49cd-a08e-00d3c7bed81f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:53.914600 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-57da5ae1-4f4c-49cd-a08e-00d3c7bed81f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:53.915050 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-57da5ae1-4f4c-49cd-a08e-00d3c7bed81f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:53.983912 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-57da5ae1-4f4c-49cd-a08e-00d3c7bed81f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 28649 microversion: 2.1 time: 0.083966 Nov 02 16:53:53.984723 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 536/1050] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:53 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 28649 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:54.628745 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d0e9ed1c-b5df-40e3-943b-5248b9693813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:54.629463 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d0e9ed1c-b5df-40e3-943b-5248b9693813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:54.637130 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0e9ed1c-b5df-40e3-943b-5248b9693813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:54.637601 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0e9ed1c-b5df-40e3-943b-5248b9693813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:54.638428 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0e9ed1c-b5df-40e3-943b-5248b9693813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:54.638882 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d0e9ed1c-b5df-40e3-943b-5248b9693813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:54.783969 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d0e9ed1c-b5df-40e3-943b-5248b9693813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:54.793010 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d0e9ed1c-b5df-40e3-943b-5248b9693813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:54.794589 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-d0e9ed1c-b5df-40e3-943b-5248b9693813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:54.795857 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d0e9ed1c-b5df-40e3-943b-5248b9693813 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.171375 Nov 02 16:53:54.796520 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 515/1051] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:53:54 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:53:54.997352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-256721a9-8d9e-4dfe-9e23-76c1ccf13113 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:54.998432 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-256721a9-8d9e-4dfe-9e23-76c1ccf13113 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:55.006222 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-256721a9-8d9e-4dfe-9e23-76c1ccf13113 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:55.006700 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-256721a9-8d9e-4dfe-9e23-76c1ccf13113 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:55.007510 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-256721a9-8d9e-4dfe-9e23-76c1ccf13113 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:55.007959 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-256721a9-8d9e-4dfe-9e23-76c1ccf13113 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:55.103650 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-256721a9-8d9e-4dfe-9e23-76c1ccf13113 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 29826 microversion: 2.1 time: 0.110673 Nov 02 16:53:55.104370 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 537/1052] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:54 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 29826 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:55.816084 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-96185b65-a9fe-4cf3-90f9-97e629e77d5d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:55.816902 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-96185b65-a9fe-4cf3-90f9-97e629e77d5d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:55.825093 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-96185b65-a9fe-4cf3-90f9-97e629e77d5d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:55.825566 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-96185b65-a9fe-4cf3-90f9-97e629e77d5d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:55.826399 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-96185b65-a9fe-4cf3-90f9-97e629e77d5d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:55.826853 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-96185b65-a9fe-4cf3-90f9-97e629e77d5d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:55.978838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-96185b65-a9fe-4cf3-90f9-97e629e77d5d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:55.987956 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-96185b65-a9fe-4cf3-90f9-97e629e77d5d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:55.989640 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-96185b65-a9fe-4cf3-90f9-97e629e77d5d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:55.990942 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-96185b65-a9fe-4cf3-90f9-97e629e77d5d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.178996 Nov 02 16:53:55.991562 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 516/1053] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:53:55 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:53:56.118389 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7e851393-9845-4140-8f50-afabc2f3b856 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:56.119344 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7e851393-9845-4140-8f50-afabc2f3b856 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:56.128496 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7e851393-9845-4140-8f50-afabc2f3b856 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:56.128963 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7e851393-9845-4140-8f50-afabc2f3b856 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:56.129928 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7e851393-9845-4140-8f50-afabc2f3b856 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:56.130377 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7e851393-9845-4140-8f50-afabc2f3b856 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:56.231247 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7e851393-9845-4140-8f50-afabc2f3b856 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 31941 microversion: 2.1 time: 0.117577 Nov 02 16:53:56.232018 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 538/1054] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:56 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 31941 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:57.010049 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-30505b62-eaf1-4ce8-b21f-750c6ddc626e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:57.011037 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-30505b62-eaf1-4ce8-b21f-750c6ddc626e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:57.018341 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30505b62-eaf1-4ce8-b21f-750c6ddc626e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:57.018807 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30505b62-eaf1-4ce8-b21f-750c6ddc626e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:57.019620 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30505b62-eaf1-4ce8-b21f-750c6ddc626e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:57.020063 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-30505b62-eaf1-4ce8-b21f-750c6ddc626e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:57.174847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-30505b62-eaf1-4ce8-b21f-750c6ddc626e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:57.185294 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-30505b62-eaf1-4ce8-b21f-750c6ddc626e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:57.186900 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-30505b62-eaf1-4ce8-b21f-750c6ddc626e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:57.188166 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-30505b62-eaf1-4ce8-b21f-750c6ddc626e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.182995 Nov 02 16:53:57.188845 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 517/1055] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:53:57 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:53:57.245193 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fb756906-6337-4b3a-aa58-4033c27e8cce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:57.246287 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fb756906-6337-4b3a-aa58-4033c27e8cce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:57.254337 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fb756906-6337-4b3a-aa58-4033c27e8cce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:57.254801 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fb756906-6337-4b3a-aa58-4033c27e8cce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:57.255617 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fb756906-6337-4b3a-aa58-4033c27e8cce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:57.256065 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fb756906-6337-4b3a-aa58-4033c27e8cce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:57.341179 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fb756906-6337-4b3a-aa58-4033c27e8cce tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 33215 microversion: 2.1 time: 0.100486 Nov 02 16:53:57.341952 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 539/1056] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:57 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 33215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:58.207789 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-8865cbc9-64a2-488c-be1f-fbd8c0eaec8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:58.208572 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8865cbc9-64a2-488c-be1f-fbd8c0eaec8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:58.215999 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8865cbc9-64a2-488c-be1f-fbd8c0eaec8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:58.216499 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8865cbc9-64a2-488c-be1f-fbd8c0eaec8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:58.217329 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8865cbc9-64a2-488c-be1f-fbd8c0eaec8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:58.217782 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8865cbc9-64a2-488c-be1f-fbd8c0eaec8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:58.355620 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1544c5ad-edd3-428e-aa0d-112e3e4edba5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:58.356762 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1544c5ad-edd3-428e-aa0d-112e3e4edba5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:58.365967 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1544c5ad-edd3-428e-aa0d-112e3e4edba5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:58.366440 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1544c5ad-edd3-428e-aa0d-112e3e4edba5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:58.367329 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1544c5ad-edd3-428e-aa0d-112e3e4edba5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:58.367780 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1544c5ad-edd3-428e-aa0d-112e3e4edba5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:58.368656 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-8865cbc9-64a2-488c-be1f-fbd8c0eaec8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:58.378073 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-8865cbc9-64a2-488c-be1f-fbd8c0eaec8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:58.379656 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-8865cbc9-64a2-488c-be1f-fbd8c0eaec8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:58.380994 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-8865cbc9-64a2-488c-be1f-fbd8c0eaec8b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.177402 Nov 02 16:53:58.381647 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 518/1057] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:53:58 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:53:58.478239 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1544c5ad-edd3-428e-aa0d-112e3e4edba5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 33921 microversion: 2.1 time: 0.126888 Nov 02 16:53:58.479287 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 540/1058] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:58 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 33921 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:53:59.400370 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3b8566cb-4f0d-45d1-8921-ed07b4f1b142 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:53:59.401110 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3b8566cb-4f0d-45d1-8921-ed07b4f1b142 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:59.407957 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3b8566cb-4f0d-45d1-8921-ed07b4f1b142 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:59.408457 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3b8566cb-4f0d-45d1-8921-ed07b4f1b142 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:59.409243 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3b8566cb-4f0d-45d1-8921-ed07b4f1b142 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:59.409688 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3b8566cb-4f0d-45d1-8921-ed07b4f1b142 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:59.492916 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-abed1f56-3d57-4bd5-8f6c-284264869aba tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:53:59.493832 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-abed1f56-3d57-4bd5-8f6c-284264869aba tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:53:59.502044 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-abed1f56-3d57-4bd5-8f6c-284264869aba tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:59.502510 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-abed1f56-3d57-4bd5-8f6c-284264869aba tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:59.503331 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-abed1f56-3d57-4bd5-8f6c-284264869aba tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:53:59.503773 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-abed1f56-3d57-4bd5-8f6c-284264869aba tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:53:59.561378 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3b8566cb-4f0d-45d1-8921-ed07b4f1b142 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:59.571659 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3b8566cb-4f0d-45d1-8921-ed07b4f1b142 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:59.573257 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3b8566cb-4f0d-45d1-8921-ed07b4f1b142 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:53:59.574858 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3b8566cb-4f0d-45d1-8921-ed07b4f1b142 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.178607 Nov 02 16:53:59.575494 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 519/1059] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:53:59 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:53:59.591300 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-abed1f56-3d57-4bd5-8f6c-284264869aba tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 34707 microversion: 2.1 time: 0.103406 Nov 02 16:53:59.591955 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 541/1060] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:53:59 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 34707 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:54:00.595001 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-13f43fae-97f3-4513-8da6-d6c9b4cfd2fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:00.595779 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-13f43fae-97f3-4513-8da6-d6c9b4cfd2fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:00.603556 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-13f43fae-97f3-4513-8da6-d6c9b4cfd2fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:00.604029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-13f43fae-97f3-4513-8da6-d6c9b4cfd2fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:00.604387 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-016099d7-38d8-4867-905e-f3dbb3cb4148 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:00.605335 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-13f43fae-97f3-4513-8da6-d6c9b4cfd2fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:00.605481 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-016099d7-38d8-4867-905e-f3dbb3cb4148 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:00.605797 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-13f43fae-97f3-4513-8da6-d6c9b4cfd2fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:00.613388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-016099d7-38d8-4867-905e-f3dbb3cb4148 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:00.613858 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-016099d7-38d8-4867-905e-f3dbb3cb4148 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:00.614683 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-016099d7-38d8-4867-905e-f3dbb3cb4148 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:00.615183 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-016099d7-38d8-4867-905e-f3dbb3cb4148 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:00.705495 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-016099d7-38d8-4867-905e-f3dbb3cb4148 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 35508 microversion: 2.1 time: 0.105546 Nov 02 16:54:00.711222 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 542/1061] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:54:00 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 35508 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 16:54:00.751889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-13f43fae-97f3-4513-8da6-d6c9b4cfd2fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:00.761990 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-13f43fae-97f3-4513-8da6-d6c9b4cfd2fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:00.763597 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-13f43fae-97f3-4513-8da6-d6c9b4cfd2fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:00.765249 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-13f43fae-97f3-4513-8da6-d6c9b4cfd2fe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.174266 Nov 02 16:54:00.765881 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 520/1062] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:00 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:01.720378 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fc874096-f202-4800-9f8e-48b219f6c77c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:01.721454 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fc874096-f202-4800-9f8e-48b219f6c77c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:01.731118 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc874096-f202-4800-9f8e-48b219f6c77c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:01.731583 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc874096-f202-4800-9f8e-48b219f6c77c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:01.732438 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc874096-f202-4800-9f8e-48b219f6c77c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:01.732888 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fc874096-f202-4800-9f8e-48b219f6c77c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:01.784982 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9c2af274-eae9-4048-aa96-92e41505ef41 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:01.785753 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9c2af274-eae9-4048-aa96-92e41505ef41 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:01.793507 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9c2af274-eae9-4048-aa96-92e41505ef41 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:01.793975 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9c2af274-eae9-4048-aa96-92e41505ef41 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:01.794779 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9c2af274-eae9-4048-aa96-92e41505ef41 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:01.795228 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9c2af274-eae9-4048-aa96-92e41505ef41 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:01.830032 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fc874096-f202-4800-9f8e-48b219f6c77c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 36552 microversion: 2.1 time: 0.114005 Nov 02 16:54:01.831239 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 543/1063] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:54:01 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 36552 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:54:01.944130 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9c2af274-eae9-4048-aa96-92e41505ef41 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:01.952662 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9c2af274-eae9-4048-aa96-92e41505ef41 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:01.954658 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9c2af274-eae9-4048-aa96-92e41505ef41 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:01.956104 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9c2af274-eae9-4048-aa96-92e41505ef41 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.175316 Nov 02 16:54:01.956747 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 521/1064] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:01 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:02.845662 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e4461311-a04d-4fef-8216-02e28d2b188f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:02.846758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e4461311-a04d-4fef-8216-02e28d2b188f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:02.855027 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4461311-a04d-4fef-8216-02e28d2b188f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:02.855488 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4461311-a04d-4fef-8216-02e28d2b188f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:02.856349 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4461311-a04d-4fef-8216-02e28d2b188f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:02.856800 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4461311-a04d-4fef-8216-02e28d2b188f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:02.947781 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e4461311-a04d-4fef-8216-02e28d2b188f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 37539 microversion: 2.1 time: 0.107791 Nov 02 16:54:02.949131 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 544/1065] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:54:02 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 37539 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:54:02.976097 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a2ad48b6-9332-4de4-8b64-f2c18e44ce4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:02.976846 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a2ad48b6-9332-4de4-8b64-f2c18e44ce4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:02.983841 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a2ad48b6-9332-4de4-8b64-f2c18e44ce4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:02.984348 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a2ad48b6-9332-4de4-8b64-f2c18e44ce4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:02.985145 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a2ad48b6-9332-4de4-8b64-f2c18e44ce4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:02.985596 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a2ad48b6-9332-4de4-8b64-f2c18e44ce4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:03.125835 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a2ad48b6-9332-4de4-8b64-f2c18e44ce4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:03.135755 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a2ad48b6-9332-4de4-8b64-f2c18e44ce4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:03.137340 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a2ad48b6-9332-4de4-8b64-f2c18e44ce4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:03.138585 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a2ad48b6-9332-4de4-8b64-f2c18e44ce4d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.167454 Nov 02 16:54:03.139204 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 522/1066] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:02 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:03.961472 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-98a38e76-07d0-41c6-b254-9758d695c7b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:03.962546 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-98a38e76-07d0-41c6-b254-9758d695c7b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:03.970556 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-98a38e76-07d0-41c6-b254-9758d695c7b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:03.971023 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-98a38e76-07d0-41c6-b254-9758d695c7b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:03.971830 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-98a38e76-07d0-41c6-b254-9758d695c7b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:03.972312 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-98a38e76-07d0-41c6-b254-9758d695c7b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:04.057208 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-98a38e76-07d0-41c6-b254-9758d695c7b5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 38170 microversion: 2.1 time: 0.100784 Nov 02 16:54:04.058355 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 545/1067] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:54:03 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 38170 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:54:04.157838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2c0da8de-1faf-4218-940c-2b833db73cad tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:04.158618 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2c0da8de-1faf-4218-940c-2b833db73cad tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:04.166136 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2c0da8de-1faf-4218-940c-2b833db73cad tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:04.166601 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2c0da8de-1faf-4218-940c-2b833db73cad tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:04.167470 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2c0da8de-1faf-4218-940c-2b833db73cad tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:04.167914 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2c0da8de-1faf-4218-940c-2b833db73cad tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:04.317335 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2c0da8de-1faf-4218-940c-2b833db73cad tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:04.326832 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2c0da8de-1faf-4218-940c-2b833db73cad tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:04.328415 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2c0da8de-1faf-4218-940c-2b833db73cad tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:04.329935 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2c0da8de-1faf-4218-940c-2b833db73cad tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.176133 Nov 02 16:54:04.330562 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 523/1068] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:04 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:05.072024 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-793e3c87-8d1c-420f-a27a-ea7d99302b4f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:05.073121 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-793e3c87-8d1c-420f-a27a-ea7d99302b4f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:05.081062 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-793e3c87-8d1c-420f-a27a-ea7d99302b4f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:05.081528 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-793e3c87-8d1c-420f-a27a-ea7d99302b4f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:05.082334 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-793e3c87-8d1c-420f-a27a-ea7d99302b4f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:05.082783 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-793e3c87-8d1c-420f-a27a-ea7d99302b4f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:05.175215 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-793e3c87-8d1c-420f-a27a-ea7d99302b4f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 38170 microversion: 2.1 time: 0.108420 Nov 02 16:54:05.176480 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 546/1069] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:54:05 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 38170 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:54:05.350694 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f74168cc-ca5c-41f3-b244-ffe710e18f12 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:05.351386 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f74168cc-ca5c-41f3-b244-ffe710e18f12 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:05.358667 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f74168cc-ca5c-41f3-b244-ffe710e18f12 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:05.359138 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f74168cc-ca5c-41f3-b244-ffe710e18f12 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:05.359954 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f74168cc-ca5c-41f3-b244-ffe710e18f12 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:05.360448 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f74168cc-ca5c-41f3-b244-ffe710e18f12 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:05.506836 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f74168cc-ca5c-41f3-b244-ffe710e18f12 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:05.515796 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f74168cc-ca5c-41f3-b244-ffe710e18f12 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:05.517384 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f74168cc-ca5c-41f3-b244-ffe710e18f12 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:05.518623 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f74168cc-ca5c-41f3-b244-ffe710e18f12 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.173105 Nov 02 16:54:05.519235 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 524/1070] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:05 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:06.191647 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-95e2bb7e-6353-4778-ab31-d6e88fb81983 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:06.192919 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-95e2bb7e-6353-4778-ab31-d6e88fb81983 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:06.207100 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-95e2bb7e-6353-4778-ab31-d6e88fb81983 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:06.207857 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-95e2bb7e-6353-4778-ab31-d6e88fb81983 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:06.209921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-95e2bb7e-6353-4778-ab31-d6e88fb81983 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:06.210713 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-95e2bb7e-6353-4778-ab31-d6e88fb81983 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:06.288848 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-95e2bb7e-6353-4778-ab31-d6e88fb81983 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 38170 microversion: 2.1 time: 0.102395 Nov 02 16:54:06.290013 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 547/1071] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:54:06 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 38170 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:54:06.539500 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c75e7afd-226b-40aa-ae6b-9955fb783bf5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:06.540248 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c75e7afd-226b-40aa-ae6b-9955fb783bf5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:06.547092 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c75e7afd-226b-40aa-ae6b-9955fb783bf5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:06.547553 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c75e7afd-226b-40aa-ae6b-9955fb783bf5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:06.548388 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c75e7afd-226b-40aa-ae6b-9955fb783bf5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:06.548837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c75e7afd-226b-40aa-ae6b-9955fb783bf5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:06.702233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-c75e7afd-226b-40aa-ae6b-9955fb783bf5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:06.712310 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-c75e7afd-226b-40aa-ae6b-9955fb783bf5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:06.713887 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-c75e7afd-226b-40aa-ae6b-9955fb783bf5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:06.715127 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c75e7afd-226b-40aa-ae6b-9955fb783bf5 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.180525 Nov 02 16:54:06.715740 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 525/1072] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:06 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:07.303071 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9bebef61-0fee-49e3-968f-3ca51b63183f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:07.304166 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9bebef61-0fee-49e3-968f-3ca51b63183f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:07.312287 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bebef61-0fee-49e3-968f-3ca51b63183f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:07.312761 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bebef61-0fee-49e3-968f-3ca51b63183f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:07.313995 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bebef61-0fee-49e3-968f-3ca51b63183f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:07.314144 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9bebef61-0fee-49e3-968f-3ca51b63183f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:07.398297 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9bebef61-0fee-49e3-968f-3ca51b63183f tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action" status: 200 len: 38299 microversion: 2.1 time: 0.099889 Nov 02 16:54:07.399099 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 548/1073] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:54:07 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/action => generated 38299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:54:07.410311 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9d83c81b-f5f7-4836-8211-5636be9ea06e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:07.410876 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9d83c81b-f5f7-4836-8211-5636be9ea06e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:07.417877 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9d83c81b-f5f7-4836-8211-5636be9ea06e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:07.418352 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9d83c81b-f5f7-4836-8211-5636be9ea06e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:07.419176 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9d83c81b-f5f7-4836-8211-5636be9ea06e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:07.419681 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9d83c81b-f5f7-4836-8211-5636be9ea06e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:07.446592 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9d83c81b-f5f7-4836-8211-5636be9ea06e tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/ips" status: 200 len: 144 microversion: 2.1 time: 0.040381 Nov 02 16:54:07.447226 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 526/1074] 10.222.0.118 () {58 vars in 1252 bytes} [Tue Nov 2 16:54:07 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/ips => generated 144 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:07.735676 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e01df758-b286-46ef-817d-eeeb4842581f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:07.736530 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e01df758-b286-46ef-817d-eeeb4842581f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:07.745313 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e01df758-b286-46ef-817d-eeeb4842581f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:07.745807 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e01df758-b286-46ef-817d-eeeb4842581f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:07.746717 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e01df758-b286-46ef-817d-eeeb4842581f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:07.747192 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e01df758-b286-46ef-817d-eeeb4842581f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:07.908388 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e01df758-b286-46ef-817d-eeeb4842581f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:07.917411 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e01df758-b286-46ef-817d-eeeb4842581f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:07.919020 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e01df758-b286-46ef-817d-eeeb4842581f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:07.920310 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e01df758-b286-46ef-817d-eeeb4842581f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.190030 Nov 02 16:54:07.920938 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 549/1075] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:07 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:08.789114 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a57a0e31-98b3-459b-b97f-38b715dfdc22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d185d9ed-2952-4f6e-b127-081bde9a647c"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:08.790278 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a57a0e31-98b3-459b-b97f-38b715dfdc22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:08.797576 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a57a0e31-98b3-459b-b97f-38b715dfdc22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:08.798039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a57a0e31-98b3-459b-b97f-38b715dfdc22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:08.798933 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a57a0e31-98b3-459b-b97f-38b715dfdc22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:08.799380 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a57a0e31-98b3-459b-b97f-38b715dfdc22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:08.941079 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ffbb2495-18ac-4b6e-8aa3-f4549f1e49af tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:08.941884 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ffbb2495-18ac-4b6e-8aa3-f4549f1e49af tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:08.949248 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ffbb2495-18ac-4b6e-8aa3-f4549f1e49af tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:08.949786 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ffbb2495-18ac-4b6e-8aa3-f4549f1e49af tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:08.950535 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ffbb2495-18ac-4b6e-8aa3-f4549f1e49af tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:08.951578 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ffbb2495-18ac-4b6e-8aa3-f4549f1e49af tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:09.089383 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a57a0e31-98b3-459b-b97f-38b715dfdc22 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304512 Nov 02 16:54:09.090303 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 527/1076] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:54:08 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:09.115511 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ffbb2495-18ac-4b6e-8aa3-f4549f1e49af tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:09.125705 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ffbb2495-18ac-4b6e-8aa3-f4549f1e49af tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:09.127718 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ffbb2495-18ac-4b6e-8aa3-f4549f1e49af tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:09.128626 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ffbb2495-18ac-4b6e-8aa3-f4549f1e49af tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1748 microversion: 2.20 time: 0.191780 Nov 02 16:54:09.129253 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 550/1077] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:08 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1748 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:54:10.152782 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3418807a-8d80-4e20-9d60-99eb4c3a3e03 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:10.154304 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3418807a-8d80-4e20-9d60-99eb4c3a3e03 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:10.162654 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3418807a-8d80-4e20-9d60-99eb4c3a3e03 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:10.164209 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3418807a-8d80-4e20-9d60-99eb4c3a3e03 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:10.165276 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3418807a-8d80-4e20-9d60-99eb4c3a3e03 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:10.165916 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3418807a-8d80-4e20-9d60-99eb4c3a3e03 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:10.751995 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3418807a-8d80-4e20-9d60-99eb4c3a3e03 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:10.763338 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3418807a-8d80-4e20-9d60-99eb4c3a3e03 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:10.765626 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3418807a-8d80-4e20-9d60-99eb4c3a3e03 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:10.767397 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3418807a-8d80-4e20-9d60-99eb4c3a3e03 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1743 microversion: 2.20 time: 0.620478 Nov 02 16:54:10.779361 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 528/1078] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:10 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1743 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:11.790788 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-11766e24-e54e-49fd-bdb7-669956b4f03c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:11.791538 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-11766e24-e54e-49fd-bdb7-669956b4f03c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:11.798908 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-11766e24-e54e-49fd-bdb7-669956b4f03c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:11.799722 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-11766e24-e54e-49fd-bdb7-669956b4f03c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:11.800576 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-11766e24-e54e-49fd-bdb7-669956b4f03c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:11.801378 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-11766e24-e54e-49fd-bdb7-669956b4f03c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:12.014025 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-11766e24-e54e-49fd-bdb7-669956b4f03c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:12.024709 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-11766e24-e54e-49fd-bdb7-669956b4f03c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:12.026717 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-11766e24-e54e-49fd-bdb7-669956b4f03c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:12.028488 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-11766e24-e54e-49fd-bdb7-669956b4f03c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1743 microversion: 2.20 time: 0.241880 Nov 02 16:54:12.029313 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 551/1079] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:11 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1743 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:12.176936 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-b8735c36-95b7-4397-8efa-8d81657b4596 req-2d9cd221-048a-4335-827a-17b46d5339b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886e9a36-a4f8-44ed-80d0-6a440f49e430", "name": "network-vif-plugged", "status": "completed", "tag": "a1262248-0dda-4533-af48-5c1338bb2d4c"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:12.176936 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:54:12.176936 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:54:12.194719 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-b8735c36-95b7-4397-8efa-8d81657b4596 req-2d9cd221-048a-4335-827a-17b46d5339b8 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:12.195769 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-b8735c36-95b7-4397-8efa-8d81657b4596 req-2d9cd221-048a-4335-827a-17b46d5339b8 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:12.211606 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-b8735c36-95b7-4397-8efa-8d81657b4596 req-2d9cd221-048a-4335-827a-17b46d5339b8 service nova] Creating event network-vif-plugged:a1262248-0dda-4533-af48-5c1338bb2d4c for instance 886e9a36-a4f8-44ed-80d0-6a440f49e430 on hv-cinder-77387 Nov 02 16:54:12.218514 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-b8735c36-95b7-4397-8efa-8d81657b4596 req-2d9cd221-048a-4335-827a-17b46d5339b8 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047266 Nov 02 16:54:12.220122 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 529/1080] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:54:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:13.060974 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-17ae84eb-e098-4935-a35a-ddb0f9d54ec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:13.062471 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-17ae84eb-e098-4935-a35a-ddb0f9d54ec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:13.070349 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-17ae84eb-e098-4935-a35a-ddb0f9d54ec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:13.070803 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-17ae84eb-e098-4935-a35a-ddb0f9d54ec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:13.071658 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-17ae84eb-e098-4935-a35a-ddb0f9d54ec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:13.072113 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-17ae84eb-e098-4935-a35a-ddb0f9d54ec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:13.267533 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-17ae84eb-e098-4935-a35a-ddb0f9d54ec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:13.278936 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-17ae84eb-e098-4935-a35a-ddb0f9d54ec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:13.280787 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-17ae84eb-e098-4935-a35a-ddb0f9d54ec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:13.282188 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-17ae84eb-e098-4935-a35a-ddb0f9d54ec6 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1743 microversion: 2.20 time: 0.228490 Nov 02 16:54:13.282860 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 552/1081] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:13 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1743 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:14.303365 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b5c2b8cd-c55c-4e5d-89e0-0297dc72827f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:14.304137 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b5c2b8cd-c55c-4e5d-89e0-0297dc72827f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:14.315838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b5c2b8cd-c55c-4e5d-89e0-0297dc72827f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:14.316829 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b5c2b8cd-c55c-4e5d-89e0-0297dc72827f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:14.318200 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b5c2b8cd-c55c-4e5d-89e0-0297dc72827f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:14.318643 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b5c2b8cd-c55c-4e5d-89e0-0297dc72827f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:14.511452 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b5c2b8cd-c55c-4e5d-89e0-0297dc72827f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:14.521648 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b5c2b8cd-c55c-4e5d-89e0-0297dc72827f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:14.523306 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b5c2b8cd-c55c-4e5d-89e0-0297dc72827f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:14.524629 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b5c2b8cd-c55c-4e5d-89e0-0297dc72827f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1743 microversion: 2.20 time: 0.227061 Nov 02 16:54:14.525236 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 530/1082] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:14 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1743 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:15.550016 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1a019954-8ae5-48e5-b352-f42998c5b84f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:15.554882 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1a019954-8ae5-48e5-b352-f42998c5b84f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:15.561741 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a019954-8ae5-48e5-b352-f42998c5b84f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:15.562214 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a019954-8ae5-48e5-b352-f42998c5b84f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:15.563056 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a019954-8ae5-48e5-b352-f42998c5b84f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:15.563522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1a019954-8ae5-48e5-b352-f42998c5b84f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:15.769346 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1a019954-8ae5-48e5-b352-f42998c5b84f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:15.781128 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1a019954-8ae5-48e5-b352-f42998c5b84f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:15.782813 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1a019954-8ae5-48e5-b352-f42998c5b84f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:15.784199 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1a019954-8ae5-48e5-b352-f42998c5b84f tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1743 microversion: 2.20 time: 0.244411 Nov 02 16:54:15.785418 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 553/1083] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:15 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1743 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:16.759002 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-595e2aec-27cc-4e6d-9803-44bccd18ad8a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:16.760112 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-595e2aec-27cc-4e6d-9803-44bccd18ad8a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:16.768194 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-595e2aec-27cc-4e6d-9803-44bccd18ad8a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:16.768800 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-595e2aec-27cc-4e6d-9803-44bccd18ad8a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:16.769884 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-595e2aec-27cc-4e6d-9803-44bccd18ad8a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:16.770418 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-595e2aec-27cc-4e6d-9803-44bccd18ad8a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:16.805656 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6745cae7-1baf-4776-94ba-56c207d5107a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:16.806321 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6745cae7-1baf-4776-94ba-56c207d5107a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:16.813439 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-595e2aec-27cc-4e6d-9803-44bccd18ad8a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059227 Nov 02 16:54:16.813684 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6745cae7-1baf-4776-94ba-56c207d5107a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:16.814084 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6745cae7-1baf-4776-94ba-56c207d5107a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:16.815007 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 531/1084] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:54:16 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:16.815421 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6745cae7-1baf-4776-94ba-56c207d5107a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:16.816068 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6745cae7-1baf-4776-94ba-56c207d5107a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:16.825363 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-fa93a4f5-f33e-4c27-b2eb-c3cc3e3359c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:16.826212 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-fa93a4f5-f33e-4c27-b2eb-c3cc3e3359c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:16.836224 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fa93a4f5-f33e-4c27-b2eb-c3cc3e3359c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:16.836893 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fa93a4f5-f33e-4c27-b2eb-c3cc3e3359c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:16.838084 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fa93a4f5-f33e-4c27-b2eb-c3cc3e3359c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:16.838738 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fa93a4f5-f33e-4c27-b2eb-c3cc3e3359c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:16.879042 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-fa93a4f5-f33e-4c27-b2eb-c3cc3e3359c2 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments/d185d9ed-2952-4f6e-b127-081bde9a647c" status: 200 len: 194 microversion: 2.1 time: 0.057427 Nov 02 16:54:16.881252 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 532/1085] 10.222.0.118 () {58 vars in 1417 bytes} [Tue Nov 2 16:54:16 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments/d185d9ed-2952-4f6e-b127-081bde9a647c => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:16.994929 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6745cae7-1baf-4776-94ba-56c207d5107a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:17.008895 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6745cae7-1baf-4776-94ba-56c207d5107a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:17.010758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6745cae7-1baf-4776-94ba-56c207d5107a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:17.012069 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6745cae7-1baf-4776-94ba-56c207d5107a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1743 microversion: 2.20 time: 0.212210 Nov 02 16:54:17.012741 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 554/1086] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:16 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1743 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:18.031422 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cc194271-357f-4342-9d17-c917c9330c9b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:18.033046 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-cc194271-357f-4342-9d17-c917c9330c9b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:18.040882 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc194271-357f-4342-9d17-c917c9330c9b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:18.041733 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc194271-357f-4342-9d17-c917c9330c9b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:18.042983 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc194271-357f-4342-9d17-c917c9330c9b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:18.043776 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc194271-357f-4342-9d17-c917c9330c9b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:18.234298 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-cc194271-357f-4342-9d17-c917c9330c9b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:18.252152 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-cc194271-357f-4342-9d17-c917c9330c9b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:18.254334 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-cc194271-357f-4342-9d17-c917c9330c9b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:18.256859 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-cc194271-357f-4342-9d17-c917c9330c9b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1743 microversion: 2.20 time: 0.229632 Nov 02 16:54:18.258148 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 533/1087] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:18 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1743 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:18.356074 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-cb5de070-2d41-4ae5-9755-b5b81cc667cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e0658a4-530a-4f18-9ccb-aa29f03f5924"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:18.358180 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-cb5de070-2d41-4ae5-9755-b5b81cc667cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:18.366674 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cb5de070-2d41-4ae5-9755-b5b81cc667cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:18.367428 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cb5de070-2d41-4ae5-9755-b5b81cc667cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:18.368309 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cb5de070-2d41-4ae5-9755-b5b81cc667cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:18.368770 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cb5de070-2d41-4ae5-9755-b5b81cc667cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:18.709105 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-cb5de070-2d41-4ae5-9755-b5b81cc667cb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358648 Nov 02 16:54:18.711194 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 555/1088] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:54:18 2021] POST /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:19.278394 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-1213d374-d2ed-446c-8f4e-3cd917612e0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:19.279927 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-1213d374-d2ed-446c-8f4e-3cd917612e0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:19.291722 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1213d374-d2ed-446c-8f4e-3cd917612e0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:19.294502 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1213d374-d2ed-446c-8f4e-3cd917612e0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:19.295447 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1213d374-d2ed-446c-8f4e-3cd917612e0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:19.295905 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-1213d374-d2ed-446c-8f4e-3cd917612e0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:19.466415 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1213d374-d2ed-446c-8f4e-3cd917612e0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:19.476401 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1213d374-d2ed-446c-8f4e-3cd917612e0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:19.477957 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-1213d374-d2ed-446c-8f4e-3cd917612e0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:19.479241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-1213d374-d2ed-446c-8f4e-3cd917612e0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1743 microversion: 2.20 time: 0.205423 Nov 02 16:54:19.479867 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 534/1089] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:19 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1743 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:20.499893 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-9be421a7-947b-4eff-9934-244991d11872 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:20.500822 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-9be421a7-947b-4eff-9934-244991d11872 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:20.508519 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9be421a7-947b-4eff-9934-244991d11872 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:20.508982 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9be421a7-947b-4eff-9934-244991d11872 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:20.510598 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9be421a7-947b-4eff-9934-244991d11872 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:20.511046 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-9be421a7-947b-4eff-9934-244991d11872 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:20.678097 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-9be421a7-947b-4eff-9934-244991d11872 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:20.687349 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-9be421a7-947b-4eff-9934-244991d11872 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:20.689043 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-9be421a7-947b-4eff-9934-244991d11872 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:20.690349 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-9be421a7-947b-4eff-9934-244991d11872 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1743 microversion: 2.20 time: 0.195876 Nov 02 16:54:20.690979 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 556/1090] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:20 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1743 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:21.711715 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-befb64d0-4a6d-4284-b967-102f07f5fea1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:21.712340 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-befb64d0-4a6d-4284-b967-102f07f5fea1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:21.719298 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-befb64d0-4a6d-4284-b967-102f07f5fea1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:21.719906 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-befb64d0-4a6d-4284-b967-102f07f5fea1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:21.720756 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-befb64d0-4a6d-4284-b967-102f07f5fea1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:21.721205 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-befb64d0-4a6d-4284-b967-102f07f5fea1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:21.922554 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-befb64d0-4a6d-4284-b967-102f07f5fea1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:21.932447 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-befb64d0-4a6d-4284-b967-102f07f5fea1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:21.934186 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-befb64d0-4a6d-4284-b967-102f07f5fea1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:21.935495 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-befb64d0-4a6d-4284-b967-102f07f5fea1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1725 microversion: 2.20 time: 0.228552 Nov 02 16:54:21.936120 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 535/1091] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:21 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:22.955584 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ec15cf84-b610-4fc5-98e2-6bcf2f6f512c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:22.956378 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ec15cf84-b610-4fc5-98e2-6bcf2f6f512c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:22.963518 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec15cf84-b610-4fc5-98e2-6bcf2f6f512c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:22.963984 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec15cf84-b610-4fc5-98e2-6bcf2f6f512c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:22.964829 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec15cf84-b610-4fc5-98e2-6bcf2f6f512c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:22.965282 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec15cf84-b610-4fc5-98e2-6bcf2f6f512c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:23.116982 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ec15cf84-b610-4fc5-98e2-6bcf2f6f512c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:23.127081 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ec15cf84-b610-4fc5-98e2-6bcf2f6f512c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:23.128709 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ec15cf84-b610-4fc5-98e2-6bcf2f6f512c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:23.130029 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ec15cf84-b610-4fc5-98e2-6bcf2f6f512c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1725 microversion: 2.20 time: 0.178675 Nov 02 16:54:23.130666 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 557/1092] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:22 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:24.150829 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7697f8e1-800c-4280-bf4b-04cffa6f4fed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:24.151615 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7697f8e1-800c-4280-bf4b-04cffa6f4fed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:24.159029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7697f8e1-800c-4280-bf4b-04cffa6f4fed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:24.159495 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7697f8e1-800c-4280-bf4b-04cffa6f4fed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:24.160346 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7697f8e1-800c-4280-bf4b-04cffa6f4fed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:24.160793 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7697f8e1-800c-4280-bf4b-04cffa6f4fed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:24.321793 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7697f8e1-800c-4280-bf4b-04cffa6f4fed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:24.332265 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7697f8e1-800c-4280-bf4b-04cffa6f4fed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:24.334550 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7697f8e1-800c-4280-bf4b-04cffa6f4fed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:24.335830 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7697f8e1-800c-4280-bf4b-04cffa6f4fed tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1725 microversion: 2.20 time: 0.190150 Nov 02 16:54:24.336475 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 536/1093] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:24 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:25.355078 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ee29ff34-2eb9-49ca-b84b-bdba64f74f23 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:25.359074 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ee29ff34-2eb9-49ca-b84b-bdba64f74f23 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:25.363475 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ee29ff34-2eb9-49ca-b84b-bdba64f74f23 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:25.363948 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ee29ff34-2eb9-49ca-b84b-bdba64f74f23 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:25.364819 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ee29ff34-2eb9-49ca-b84b-bdba64f74f23 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:25.365273 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ee29ff34-2eb9-49ca-b84b-bdba64f74f23 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:25.510120 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ee29ff34-2eb9-49ca-b84b-bdba64f74f23 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:25.519730 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ee29ff34-2eb9-49ca-b84b-bdba64f74f23 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:25.521559 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ee29ff34-2eb9-49ca-b84b-bdba64f74f23 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:25.523774 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ee29ff34-2eb9-49ca-b84b-bdba64f74f23 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1668 microversion: 2.20 time: 0.173336 Nov 02 16:54:25.524463 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 558/1094] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:25 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1668 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:25.542741 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-326f9935-b4ff-43c2-a003-f7e3520517b4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb46ac1e-69d0-4398-87d0-4da92a88254b"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:25.543915 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-326f9935-b4ff-43c2-a003-f7e3520517b4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:25.552241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-326f9935-b4ff-43c2-a003-f7e3520517b4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:25.552761 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-326f9935-b4ff-43c2-a003-f7e3520517b4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:25.553742 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-326f9935-b4ff-43c2-a003-f7e3520517b4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:25.554196 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-326f9935-b4ff-43c2-a003-f7e3520517b4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:25.864486 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-326f9935-b4ff-43c2-a003-f7e3520517b4 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.326037 Nov 02 16:54:25.865120 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 537/1095] 10.222.0.118 () {62 vars in 1368 bytes} [Tue Nov 2 16:54:25 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/os-volume_attachments => generated 188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 16:54:25.982073 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e38d2613-312a-491c-9596-4ef4c91db4a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:25.982609 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e38d2613-312a-491c-9596-4ef4c91db4a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:25.989292 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e38d2613-312a-491c-9596-4ef4c91db4a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:25.989779 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e38d2613-312a-491c-9596-4ef4c91db4a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:25.990949 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e38d2613-312a-491c-9596-4ef4c91db4a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:25.991712 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e38d2613-312a-491c-9596-4ef4c91db4a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:26.107920 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-1dd835f5-ca6f-4930-a2f8-025cfefbd228 req-695c2a36-a09a-46c6-b783-59fea3c6728d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886e9a36-a4f8-44ed-80d0-6a440f49e430", "name": "network-vif-unplugged", "status": "completed", "tag": "a1262248-0dda-4533-af48-5c1338bb2d4c"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:26.111552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:54:26.111552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:54:26.125753 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-1dd835f5-ca6f-4930-a2f8-025cfefbd228 req-695c2a36-a09a-46c6-b783-59fea3c6728d service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:26.126074 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-1dd835f5-ca6f-4930-a2f8-025cfefbd228 req-695c2a36-a09a-46c6-b783-59fea3c6728d service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:26.142309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.compute.server_external_events [req-1dd835f5-ca6f-4930-a2f8-025cfefbd228 req-695c2a36-a09a-46c6-b783-59fea3c6728d service nova] Unable to find a host for instance 886e9a36-a4f8-44ed-80d0-6a440f49e430. Dropping event network-vif-unplugged {{(pid=127648) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 02 16:54:26.143429 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-1dd835f5-ca6f-4930-a2f8-025cfefbd228 req-695c2a36-a09a-46c6-b783-59fea3c6728d service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040841 Nov 02 16:54:26.144572 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 538/1096] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:54:26 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 16:54:26.267312 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e38d2613-312a-491c-9596-4ef4c91db4a3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "DELETE /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/os-volume_attachments/bb46ac1e-69d0-4398-87d0-4da92a88254b" status: 202 len: 0 microversion: 2.20 time: 0.289565 Nov 02 16:54:26.267989 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 559/1097] 10.222.0.118 () {60 vars in 1461 bytes} [Tue Nov 2 16:54:25 2021] DELETE /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/os-volume_attachments/bb46ac1e-69d0-4398-87d0-4da92a88254b => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:54:26.281100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-bb6e04fa-1949-4adc-8317-dab568074ccb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:26.282158 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-bb6e04fa-1949-4adc-8317-dab568074ccb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:26.290026 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bb6e04fa-1949-4adc-8317-dab568074ccb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:26.290508 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bb6e04fa-1949-4adc-8317-dab568074ccb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:26.291335 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bb6e04fa-1949-4adc-8317-dab568074ccb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:26.291929 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bb6e04fa-1949-4adc-8317-dab568074ccb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:26.334046 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-bb6e04fa-1949-4adc-8317-dab568074ccb tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056983 Nov 02 16:54:26.335100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 539/1098] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:54:26 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:26.337589 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-97942154-5351-46cd-90db-181eaa7fe657 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:26.338366 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-97942154-5351-46cd-90db-181eaa7fe657 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:26.346093 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-97942154-5351-46cd-90db-181eaa7fe657 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:26.346554 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-97942154-5351-46cd-90db-181eaa7fe657 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:26.347364 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-97942154-5351-46cd-90db-181eaa7fe657 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:26.347816 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-97942154-5351-46cd-90db-181eaa7fe657 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:26.450778 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-97942154-5351-46cd-90db-181eaa7fe657 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action" status: 202 len: 0 microversion: 2.20 time: 0.118354 Nov 02 16:54:26.451728 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 560/1099] 10.222.0.118 () {62 vars in 1323 bytes} [Tue Nov 2 16:54:26 2021] POST /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:54:26.460822 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a2114473-74d4-4cb8-b994-1117d9b65037 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:26.461781 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a2114473-74d4-4cb8-b994-1117d9b65037 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:26.468504 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a2114473-74d4-4cb8-b994-1117d9b65037 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:26.469216 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a2114473-74d4-4cb8-b994-1117d9b65037 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:26.470132 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a2114473-74d4-4cb8-b994-1117d9b65037 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:26.470621 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a2114473-74d4-4cb8-b994-1117d9b65037 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:26.620294 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a2114473-74d4-4cb8-b994-1117d9b65037 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:26.629512 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a2114473-74d4-4cb8-b994-1117d9b65037 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:26.631549 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a2114473-74d4-4cb8-b994-1117d9b65037 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:26.633002 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a2114473-74d4-4cb8-b994-1117d9b65037 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1676 microversion: 2.20 time: 0.177051 Nov 02 16:54:26.633667 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 540/1100] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:26 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:54:26.800271 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e8aaeeeb-4ab6-4530-bb42-793d354c9edf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:26.801383 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e8aaeeeb-4ab6-4530-bb42-793d354c9edf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:26.812596 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e8aaeeeb-4ab6-4530-bb42-793d354c9edf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:26.813225 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e8aaeeeb-4ab6-4530-bb42-793d354c9edf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:26.814189 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e8aaeeeb-4ab6-4530-bb42-793d354c9edf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:26.814936 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e8aaeeeb-4ab6-4530-bb42-793d354c9edf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:26.858962 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e8aaeeeb-4ab6-4530-bb42-793d354c9edf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments/d185d9ed-2952-4f6e-b127-081bde9a647c" status: 200 len: 194 microversion: 2.1 time: 0.065774 Nov 02 16:54:26.859954 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 561/1101] 10.222.0.118 () {58 vars in 1417 bytes} [Tue Nov 2 16:54:26 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments/d185d9ed-2952-4f6e-b127-081bde9a647c => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:26.871326 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-140b73e4-bb9a-457d-a80e-9ec85d5ba758 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:26.872063 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-140b73e4-bb9a-457d-a80e-9ec85d5ba758 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:26.879630 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-140b73e4-bb9a-457d-a80e-9ec85d5ba758 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:26.880544 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-140b73e4-bb9a-457d-a80e-9ec85d5ba758 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:26.882878 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-140b73e4-bb9a-457d-a80e-9ec85d5ba758 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:26.883352 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-140b73e4-bb9a-457d-a80e-9ec85d5ba758 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:26.985962 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.objects.instance [None req-140b73e4-bb9a-457d-a80e-9ec85d5ba758 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lazy-loading 'services' on Instance uuid 61572fbe-ccf7-4ed4-80ab-eda95f187229 {{(pid=127648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:54:27.065184 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-140b73e4-bb9a-457d-a80e-9ec85d5ba758 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "DELETE /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments/d185d9ed-2952-4f6e-b127-081bde9a647c" status: 202 len: 0 microversion: 2.1 time: 0.199000 Nov 02 16:54:27.065891 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 541/1102] 10.222.0.118 () {58 vars in 1420 bytes} [Tue Nov 2 16:54:26 2021] DELETE /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments/d185d9ed-2952-4f6e-b127-081bde9a647c => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:54:27.651793 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-f609dbb0-343b-4393-92bd-12bce6bf1085 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:27.652575 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-f609dbb0-343b-4393-92bd-12bce6bf1085 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:27.659522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f609dbb0-343b-4393-92bd-12bce6bf1085 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:27.659985 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f609dbb0-343b-4393-92bd-12bce6bf1085 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:27.660831 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f609dbb0-343b-4393-92bd-12bce6bf1085 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:27.661282 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-f609dbb0-343b-4393-92bd-12bce6bf1085 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:27.801435 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f609dbb0-343b-4393-92bd-12bce6bf1085 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:27.811048 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f609dbb0-343b-4393-92bd-12bce6bf1085 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:27.812694 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-f609dbb0-343b-4393-92bd-12bce6bf1085 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:27.813909 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-f609dbb0-343b-4393-92bd-12bce6bf1085 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.166515 Nov 02 16:54:27.814527 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 562/1103] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:27 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:28.835798 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-5de86775-a471-42e8-952c-c0a8cd727cbe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:28.836640 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-5de86775-a471-42e8-952c-c0a8cd727cbe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:28.844898 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5de86775-a471-42e8-952c-c0a8cd727cbe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:28.845405 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5de86775-a471-42e8-952c-c0a8cd727cbe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:28.846232 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5de86775-a471-42e8-952c-c0a8cd727cbe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:28.846676 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-5de86775-a471-42e8-952c-c0a8cd727cbe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:29.047146 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5de86775-a471-42e8-952c-c0a8cd727cbe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:29.057574 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5de86775-a471-42e8-952c-c0a8cd727cbe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:29.059522 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-5de86775-a471-42e8-952c-c0a8cd727cbe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:29.061061 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-5de86775-a471-42e8-952c-c0a8cd727cbe tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.231051 Nov 02 16:54:29.072704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 542/1104] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:28 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 16:54:29.252821 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7eb0bda2-9909-40a9-8be0-4c67a864046a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:29.253562 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7eb0bda2-9909-40a9-8be0-4c67a864046a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:29.261480 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7eb0bda2-9909-40a9-8be0-4c67a864046a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:29.262323 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7eb0bda2-9909-40a9-8be0-4c67a864046a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:29.263459 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7eb0bda2-9909-40a9-8be0-4c67a864046a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:29.264262 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7eb0bda2-9909-40a9-8be0-4c67a864046a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:29.301553 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7eb0bda2-9909-40a9-8be0-4c67a864046a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments/7e0658a4-530a-4f18-9ccb-aa29f03f5924" status: 200 len: 194 microversion: 2.1 time: 0.052976 Nov 02 16:54:29.302328 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 563/1105] 10.222.0.118 () {58 vars in 1417 bytes} [Tue Nov 2 16:54:29 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments/7e0658a4-530a-4f18-9ccb-aa29f03f5924 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:29.314639 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7980d104-980a-4532-a319-d5a86a1acd8c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:29.315411 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7980d104-980a-4532-a319-d5a86a1acd8c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:29.324309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7980d104-980a-4532-a319-d5a86a1acd8c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:29.327233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7980d104-980a-4532-a319-d5a86a1acd8c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:29.327233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7980d104-980a-4532-a319-d5a86a1acd8c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:29.327233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7980d104-980a-4532-a319-d5a86a1acd8c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:29.424559 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.objects.instance [None req-7980d104-980a-4532-a319-d5a86a1acd8c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lazy-loading 'services' on Instance uuid 61572fbe-ccf7-4ed4-80ab-eda95f187229 {{(pid=127648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:54:29.509385 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7980d104-980a-4532-a319-d5a86a1acd8c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "DELETE /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments/7e0658a4-530a-4f18-9ccb-aa29f03f5924" status: 202 len: 0 microversion: 2.1 time: 0.198748 Nov 02 16:54:29.510016 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 543/1106] 10.222.0.118 () {58 vars in 1420 bytes} [Tue Nov 2 16:54:29 2021] DELETE /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments/7e0658a4-530a-4f18-9ccb-aa29f03f5924 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:54:30.081578 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4fec1fd3-3963-4fbc-9128-7451c3b63154 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:30.082489 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-4fec1fd3-3963-4fbc-9128-7451c3b63154 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:30.090452 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4fec1fd3-3963-4fbc-9128-7451c3b63154 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:30.091401 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4fec1fd3-3963-4fbc-9128-7451c3b63154 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:30.092566 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4fec1fd3-3963-4fbc-9128-7451c3b63154 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:30.093372 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-4fec1fd3-3963-4fbc-9128-7451c3b63154 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:30.260902 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-4fec1fd3-3963-4fbc-9128-7451c3b63154 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:30.274925 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-4fec1fd3-3963-4fbc-9128-7451c3b63154 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:30.276923 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-4fec1fd3-3963-4fbc-9128-7451c3b63154 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:30.278522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4fec1fd3-3963-4fbc-9128-7451c3b63154 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.201206 Nov 02 16:54:30.279148 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 564/1107] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:30 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:31.299224 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3acaf6c2-c8df-441c-8897-e4a75fdd320b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:31.300029 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3acaf6c2-c8df-441c-8897-e4a75fdd320b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:31.309493 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3acaf6c2-c8df-441c-8897-e4a75fdd320b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:31.310048 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3acaf6c2-c8df-441c-8897-e4a75fdd320b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:31.311018 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3acaf6c2-c8df-441c-8897-e4a75fdd320b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:31.311521 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3acaf6c2-c8df-441c-8897-e4a75fdd320b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:31.471551 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3acaf6c2-c8df-441c-8897-e4a75fdd320b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:31.482783 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3acaf6c2-c8df-441c-8897-e4a75fdd320b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:31.484412 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3acaf6c2-c8df-441c-8897-e4a75fdd320b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:31.485702 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3acaf6c2-c8df-441c-8897-e4a75fdd320b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.191159 Nov 02 16:54:31.486334 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 544/1108] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:31 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:32.509403 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c812c43a-fb19-444c-9e05-cf19b70b4a45 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:32.511929 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c812c43a-fb19-444c-9e05-cf19b70b4a45 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:32.520059 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c812c43a-fb19-444c-9e05-cf19b70b4a45 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:32.520554 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c812c43a-fb19-444c-9e05-cf19b70b4a45 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:32.521373 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c812c43a-fb19-444c-9e05-cf19b70b4a45 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:32.521816 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c812c43a-fb19-444c-9e05-cf19b70b4a45 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:32.674634 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c812c43a-fb19-444c-9e05-cf19b70b4a45 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:32.686821 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c812c43a-fb19-444c-9e05-cf19b70b4a45 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:32.689675 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c812c43a-fb19-444c-9e05-cf19b70b4a45 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:32.690913 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c812c43a-fb19-444c-9e05-cf19b70b4a45 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.188869 Nov 02 16:54:32.692211 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 565/1109] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:32 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:33.712368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-819e70fd-349c-4644-b322-c1d053f6634e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:33.713136 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-819e70fd-349c-4644-b322-c1d053f6634e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:33.721381 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-819e70fd-349c-4644-b322-c1d053f6634e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:33.721855 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-819e70fd-349c-4644-b322-c1d053f6634e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:33.722800 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-819e70fd-349c-4644-b322-c1d053f6634e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:33.723266 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-819e70fd-349c-4644-b322-c1d053f6634e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:33.883630 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-819e70fd-349c-4644-b322-c1d053f6634e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:33.893194 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-819e70fd-349c-4644-b322-c1d053f6634e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:33.894955 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-819e70fd-349c-4644-b322-c1d053f6634e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:33.896248 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-819e70fd-349c-4644-b322-c1d053f6634e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.189157 Nov 02 16:54:33.896872 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 545/1110] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:33 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:34.918103 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c7026659-3173-4dc9-b435-b46ab7749cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:34.919086 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c7026659-3173-4dc9-b435-b46ab7749cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:34.926581 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c7026659-3173-4dc9-b435-b46ab7749cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:34.927042 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c7026659-3173-4dc9-b435-b46ab7749cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:34.928502 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c7026659-3173-4dc9-b435-b46ab7749cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:34.929365 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c7026659-3173-4dc9-b435-b46ab7749cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:35.111360 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c7026659-3173-4dc9-b435-b46ab7749cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:35.121935 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c7026659-3173-4dc9-b435-b46ab7749cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:35.123542 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c7026659-3173-4dc9-b435-b46ab7749cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:35.124859 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c7026659-3173-4dc9-b435-b46ab7749cde tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.212080 Nov 02 16:54:35.125494 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 566/1111] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:34 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:36.147234 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4664d318-1395-4f61-9e02-96b1af7fee70 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:36.151725 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4664d318-1395-4f61-9e02-96b1af7fee70 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:36.162722 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4664d318-1395-4f61-9e02-96b1af7fee70 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:36.163686 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4664d318-1395-4f61-9e02-96b1af7fee70 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:36.165282 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4664d318-1395-4f61-9e02-96b1af7fee70 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:36.165861 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4664d318-1395-4f61-9e02-96b1af7fee70 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:36.354253 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4664d318-1395-4f61-9e02-96b1af7fee70 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:36.366174 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4664d318-1395-4f61-9e02-96b1af7fee70 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:36.368764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4664d318-1395-4f61-9e02-96b1af7fee70 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:36.370433 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4664d318-1395-4f61-9e02-96b1af7fee70 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.229021 Nov 02 16:54:36.371539 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 546/1112] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:36 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:37.394160 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-fe02e0b4-9db5-47f9-9a14-109ab30bc547 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:37.395240 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-fe02e0b4-9db5-47f9-9a14-109ab30bc547 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:37.403618 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fe02e0b4-9db5-47f9-9a14-109ab30bc547 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:37.404468 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fe02e0b4-9db5-47f9-9a14-109ab30bc547 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:37.405453 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fe02e0b4-9db5-47f9-9a14-109ab30bc547 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:37.406070 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-fe02e0b4-9db5-47f9-9a14-109ab30bc547 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:37.563638 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-fe02e0b4-9db5-47f9-9a14-109ab30bc547 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:37.573412 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-fe02e0b4-9db5-47f9-9a14-109ab30bc547 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:37.574982 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-fe02e0b4-9db5-47f9-9a14-109ab30bc547 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:37.576267 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-fe02e0b4-9db5-47f9-9a14-109ab30bc547 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.186667 Nov 02 16:54:37.576891 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 567/1113] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:37 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:38.596846 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-086f453b-1b8b-40dd-9bd7-d36297b3c35c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:38.597759 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-086f453b-1b8b-40dd-9bd7-d36297b3c35c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:38.605388 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-086f453b-1b8b-40dd-9bd7-d36297b3c35c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:38.605858 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-086f453b-1b8b-40dd-9bd7-d36297b3c35c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:38.606674 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-086f453b-1b8b-40dd-9bd7-d36297b3c35c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:38.607116 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-086f453b-1b8b-40dd-9bd7-d36297b3c35c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:38.796004 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-086f453b-1b8b-40dd-9bd7-d36297b3c35c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:38.805087 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-086f453b-1b8b-40dd-9bd7-d36297b3c35c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:38.806705 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-086f453b-1b8b-40dd-9bd7-d36297b3c35c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:38.809007 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-086f453b-1b8b-40dd-9bd7-d36297b3c35c tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.216250 Nov 02 16:54:38.809643 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 547/1114] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:38 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:39.828840 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-840e5638-25c8-4c93-94bf-9f4196f3525b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:39.829664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-840e5638-25c8-4c93-94bf-9f4196f3525b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:39.837143 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-840e5638-25c8-4c93-94bf-9f4196f3525b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:39.837608 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-840e5638-25c8-4c93-94bf-9f4196f3525b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:39.838410 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-840e5638-25c8-4c93-94bf-9f4196f3525b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:39.838857 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-840e5638-25c8-4c93-94bf-9f4196f3525b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:39.989918 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-840e5638-25c8-4c93-94bf-9f4196f3525b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:39.999060 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-840e5638-25c8-4c93-94bf-9f4196f3525b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:40.000657 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-840e5638-25c8-4c93-94bf-9f4196f3525b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:40.001891 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-840e5638-25c8-4c93-94bf-9f4196f3525b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.177323 Nov 02 16:54:40.002503 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 568/1115] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:39 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:41.022535 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f5c52fed-071a-41ee-be48-eb886cdd4003 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:41.023589 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f5c52fed-071a-41ee-be48-eb886cdd4003 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:41.031160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f5c52fed-071a-41ee-be48-eb886cdd4003 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:41.032045 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f5c52fed-071a-41ee-be48-eb886cdd4003 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:41.033698 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f5c52fed-071a-41ee-be48-eb886cdd4003 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:41.034234 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f5c52fed-071a-41ee-be48-eb886cdd4003 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:41.230396 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f5c52fed-071a-41ee-be48-eb886cdd4003 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:41.243191 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f5c52fed-071a-41ee-be48-eb886cdd4003 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:41.245569 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f5c52fed-071a-41ee-be48-eb886cdd4003 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:41.246116 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f5c52fed-071a-41ee-be48-eb886cdd4003 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.228408 Nov 02 16:54:41.246816 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 548/1116] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:41 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:42.266221 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-748118e6-9690-4023-8f36-bff86736d984 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:42.267663 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-748118e6-9690-4023-8f36-bff86736d984 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:42.276802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-748118e6-9690-4023-8f36-bff86736d984 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:42.277181 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-748118e6-9690-4023-8f36-bff86736d984 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:42.277728 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-748118e6-9690-4023-8f36-bff86736d984 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:42.278179 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-748118e6-9690-4023-8f36-bff86736d984 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:42.364388 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4d04462a-b5c3-42af-9a48-d96f45d1ce0a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:42.366900 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4d04462a-b5c3-42af-9a48-d96f45d1ce0a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:42.374145 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d04462a-b5c3-42af-9a48-d96f45d1ce0a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:42.374613 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d04462a-b5c3-42af-9a48-d96f45d1ce0a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:42.375428 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d04462a-b5c3-42af-9a48-d96f45d1ce0a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:42.375878 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4d04462a-b5c3-42af-9a48-d96f45d1ce0a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:42.409259 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4d04462a-b5c3-42af-9a48-d96f45d1ce0a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048940 Nov 02 16:54:42.410328 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 549/1117] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:54:42 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:54:42.427931 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-748118e6-9690-4023-8f36-bff86736d984 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:42.437777 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-748118e6-9690-4023-8f36-bff86736d984 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:42.439356 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-748118e6-9690-4023-8f36-bff86736d984 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:42.441140 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-748118e6-9690-4023-8f36-bff86736d984 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.179311 Nov 02 16:54:42.441763 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 569/1118] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:42 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:42.524288 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-34afca18-7323-4dc8-8b5d-05f79ad5d7a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:42.525345 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-34afca18-7323-4dc8-8b5d-05f79ad5d7a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:42.531972 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-34afca18-7323-4dc8-8b5d-05f79ad5d7a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:42.532486 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-34afca18-7323-4dc8-8b5d-05f79ad5d7a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:42.533296 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-34afca18-7323-4dc8-8b5d-05f79ad5d7a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:42.533740 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-34afca18-7323-4dc8-8b5d-05f79ad5d7a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:42.565334 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-34afca18-7323-4dc8-8b5d-05f79ad5d7a4 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046235 Nov 02 16:54:42.565963 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 550/1119] 10.222.0.118 () {58 vars in 1306 bytes} [Tue Nov 2 16:54:42 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 16:54:42.624664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ef5f1b08-deab-49d8-b1ea-70794357eae8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:42.625276 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ef5f1b08-deab-49d8-b1ea-70794357eae8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:42.631661 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ef5f1b08-deab-49d8-b1ea-70794357eae8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:42.633446 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ef5f1b08-deab-49d8-b1ea-70794357eae8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:42.634302 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ef5f1b08-deab-49d8-b1ea-70794357eae8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:42.635125 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ef5f1b08-deab-49d8-b1ea-70794357eae8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:42.662030 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ef5f1b08-deab-49d8-b1ea-70794357eae8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Going to try to terminate instance {{(pid=127649) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:54:42.748468 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ef5f1b08-deab-49d8-b1ea-70794357eae8 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "DELETE /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 204 len: 0 microversion: 2.1 time: 0.127888 Nov 02 16:54:42.749153 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 570/1120] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:54:42 2021] DELETE /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:54:42.758700 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-aaf7c3ce-8e12-481e-9560-eb552e5cfdbe tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:42.759354 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-aaf7c3ce-8e12-481e-9560-eb552e5cfdbe tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:42.766483 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aaf7c3ce-8e12-481e-9560-eb552e5cfdbe tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:42.766983 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aaf7c3ce-8e12-481e-9560-eb552e5cfdbe tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:42.767811 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aaf7c3ce-8e12-481e-9560-eb552e5cfdbe tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:42.768312 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aaf7c3ce-8e12-481e-9560-eb552e5cfdbe tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:42.921126 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-aaf7c3ce-8e12-481e-9560-eb552e5cfdbe tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:42.929897 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-aaf7c3ce-8e12-481e-9560-eb552e5cfdbe tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1675 microversion: 2.1 time: 0.175590 Nov 02 16:54:42.930559 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 551/1121] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:54:42 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:54:43.461225 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7044111a-77ae-487a-8a1a-43650de6895a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:43.462008 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7044111a-77ae-487a-8a1a-43650de6895a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:43.469188 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7044111a-77ae-487a-8a1a-43650de6895a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:43.469646 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7044111a-77ae-487a-8a1a-43650de6895a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:43.470480 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7044111a-77ae-487a-8a1a-43650de6895a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:43.470917 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7044111a-77ae-487a-8a1a-43650de6895a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:43.619013 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7044111a-77ae-487a-8a1a-43650de6895a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:43.628216 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7044111a-77ae-487a-8a1a-43650de6895a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:43.629773 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7044111a-77ae-487a-8a1a-43650de6895a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:43.631038 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7044111a-77ae-487a-8a1a-43650de6895a tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.174955 Nov 02 16:54:43.631658 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 571/1122] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:43 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:43.948391 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-8ccaf1b0-ae5b-4360-8ebf-1538afa0e63b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:43.949473 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8ccaf1b0-ae5b-4360-8ebf-1538afa0e63b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:43.956572 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8ccaf1b0-ae5b-4360-8ebf-1538afa0e63b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:43.957031 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8ccaf1b0-ae5b-4360-8ebf-1538afa0e63b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:43.957851 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8ccaf1b0-ae5b-4360-8ebf-1538afa0e63b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:43.958296 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8ccaf1b0-ae5b-4360-8ebf-1538afa0e63b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:44.115570 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-8ccaf1b0-ae5b-4360-8ebf-1538afa0e63b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:44.125047 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-8ccaf1b0-ae5b-4360-8ebf-1538afa0e63b tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1675 microversion: 2.1 time: 0.181367 Nov 02 16:54:44.125772 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 552/1123] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:54:43 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:54:44.264653 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-97f39a86-cdcc-4a1a-979b-fbcea250dcab req-0e1d6583-0a30-4697-9d2c-eceef1a1c13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886e9a36-a4f8-44ed-80d0-6a440f49e430", "name": "network-vif-plugged", "status": "completed", "tag": "a1262248-0dda-4533-af48-5c1338bb2d4c"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:44.266920 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:54:44.266920 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:54:44.276360 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-97f39a86-cdcc-4a1a-979b-fbcea250dcab req-0e1d6583-0a30-4697-9d2c-eceef1a1c13f service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:44.276823 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-97f39a86-cdcc-4a1a-979b-fbcea250dcab req-0e1d6583-0a30-4697-9d2c-eceef1a1c13f service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:44.292110 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-97f39a86-cdcc-4a1a-979b-fbcea250dcab req-0e1d6583-0a30-4697-9d2c-eceef1a1c13f service nova] Creating event network-vif-plugged:a1262248-0dda-4533-af48-5c1338bb2d4c for instance 886e9a36-a4f8-44ed-80d0-6a440f49e430 on hv-cinder-77387 Nov 02 16:54:44.298778 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-97f39a86-cdcc-4a1a-979b-fbcea250dcab req-0e1d6583-0a30-4697-9d2c-eceef1a1c13f service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038932 Nov 02 16:54:44.299452 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 572/1124] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:54:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:54:44.651920 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0ed16abe-d4d5-4fc8-b3f2-29695f44a9c3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:44.652686 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0ed16abe-d4d5-4fc8-b3f2-29695f44a9c3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:44.659625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0ed16abe-d4d5-4fc8-b3f2-29695f44a9c3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:44.660096 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0ed16abe-d4d5-4fc8-b3f2-29695f44a9c3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:44.660963 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0ed16abe-d4d5-4fc8-b3f2-29695f44a9c3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:44.661412 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0ed16abe-d4d5-4fc8-b3f2-29695f44a9c3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:44.805670 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0ed16abe-d4d5-4fc8-b3f2-29695f44a9c3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:44.815304 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0ed16abe-d4d5-4fc8-b3f2-29695f44a9c3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:44.816973 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0ed16abe-d4d5-4fc8-b3f2-29695f44a9c3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:44.818311 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0ed16abe-d4d5-4fc8-b3f2-29695f44a9c3 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.170881 Nov 02 16:54:44.818945 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 553/1125] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:44 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:45.146109 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ceba8f0e-decb-4bcd-ba80-d6229cc86f1a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:45.147837 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ceba8f0e-decb-4bcd-ba80-d6229cc86f1a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:45.155658 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ceba8f0e-decb-4bcd-ba80-d6229cc86f1a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:45.156122 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ceba8f0e-decb-4bcd-ba80-d6229cc86f1a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:45.156977 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ceba8f0e-decb-4bcd-ba80-d6229cc86f1a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:45.157421 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ceba8f0e-decb-4bcd-ba80-d6229cc86f1a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:45.306317 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ceba8f0e-decb-4bcd-ba80-d6229cc86f1a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:45.315522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ceba8f0e-decb-4bcd-ba80-d6229cc86f1a tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1675 microversion: 2.1 time: 0.175152 Nov 02 16:54:45.316207 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 573/1126] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:54:45 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:54:45.782507 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-a93de06e-e4fd-4121-8dab-7a4168a688ad req-752a1ed3-94ac-4c99-a2a2-b694a132466e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61572fbe-ccf7-4ed4-80ab-eda95f187229", "name": "network-vif-deleted", "tag": "f902bd79-9248-4da6-847e-36b46e3fa1b9"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:45.784539 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:54:45.784539 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:54:45.795950 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-a93de06e-e4fd-4121-8dab-7a4168a688ad req-752a1ed3-94ac-4c99-a2a2-b694a132466e service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:45.816479 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-a93de06e-e4fd-4121-8dab-7a4168a688ad req-752a1ed3-94ac-4c99-a2a2-b694a132466e service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:45.839723 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2cd7a0dd-0011-407b-a7d8-ad7dad8875ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:45.841082 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2cd7a0dd-0011-407b-a7d8-ad7dad8875ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:45.854230 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-a93de06e-e4fd-4121-8dab-7a4168a688ad req-752a1ed3-94ac-4c99-a2a2-b694a132466e service nova] Creating event network-vif-deleted:f902bd79-9248-4da6-847e-36b46e3fa1b9 for instance 61572fbe-ccf7-4ed4-80ab-eda95f187229 on hv-cinder-77387 Nov 02 16:54:45.865448 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2cd7a0dd-0011-407b-a7d8-ad7dad8875ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:45.866234 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2cd7a0dd-0011-407b-a7d8-ad7dad8875ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:45.869802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2cd7a0dd-0011-407b-a7d8-ad7dad8875ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:45.871435 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2cd7a0dd-0011-407b-a7d8-ad7dad8875ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:45.873914 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-a93de06e-e4fd-4121-8dab-7a4168a688ad req-752a1ed3-94ac-4c99-a2a2-b694a132466e service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098282 Nov 02 16:54:45.877897 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 554/1127] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:54:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:46.111191 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2cd7a0dd-0011-407b-a7d8-ad7dad8875ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:46.127324 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2cd7a0dd-0011-407b-a7d8-ad7dad8875ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:46.135008 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2cd7a0dd-0011-407b-a7d8-ad7dad8875ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:46.137090 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2cd7a0dd-0011-407b-a7d8-ad7dad8875ee tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1734 microversion: 2.20 time: 0.303625 Nov 02 16:54:46.138354 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 574/1128] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:45 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1734 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:46.348494 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-455c01e8-7532-4508-9b75-c3774d055b74 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:46.350168 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-455c01e8-7532-4508-9b75-c3774d055b74 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:46.369124 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-455c01e8-7532-4508-9b75-c3774d055b74 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:46.370020 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-455c01e8-7532-4508-9b75-c3774d055b74 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:46.371118 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-455c01e8-7532-4508-9b75-c3774d055b74 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:46.371795 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-455c01e8-7532-4508-9b75-c3774d055b74 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:46.423385 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-455c01e8-7532-4508-9b75-c3774d055b74 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:46.424293 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-455c01e8-7532-4508-9b75-c3774d055b74 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:46.425117 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.objects.instance [None req-455c01e8-7532-4508-9b75-c3774d055b74 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lazy-loading 'fault' on Instance uuid 61572fbe-ccf7-4ed4-80ab-eda95f187229 {{(pid=127648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:54:46.524324 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-455c01e8-7532-4508-9b75-c3774d055b74 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821a58487d5b4087bac538d532382aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a575c6bd2e574ad19dc299cc1df253f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:46.533967 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-455c01e8-7532-4508-9b75-c3774d055b74 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 200 len: 1330 microversion: 2.1 time: 0.198920 Nov 02 16:54:46.535125 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 555/1129] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:54:46 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 1330 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:54:47.156802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8f84725f-7b7f-4ce5-b345-02fdf7acb7fb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:47.157727 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8f84725f-7b7f-4ce5-b345-02fdf7acb7fb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:47.168248 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8f84725f-7b7f-4ce5-b345-02fdf7acb7fb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:47.168731 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8f84725f-7b7f-4ce5-b345-02fdf7acb7fb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:47.169661 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8f84725f-7b7f-4ce5-b345-02fdf7acb7fb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:47.170173 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8f84725f-7b7f-4ce5-b345-02fdf7acb7fb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:47.332980 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8f84725f-7b7f-4ce5-b345-02fdf7acb7fb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:47.342632 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8f84725f-7b7f-4ce5-b345-02fdf7acb7fb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:47.344218 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8f84725f-7b7f-4ce5-b345-02fdf7acb7fb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:54:47.345473 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8f84725f-7b7f-4ce5-b345-02fdf7acb7fb tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1721 microversion: 2.20 time: 0.193782 Nov 02 16:54:47.346101 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 575/1130] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:54:47 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:54:47.553263 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3c4d2bc9-6949-461f-a5de-fdc6e855dbaf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:47.554185 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3c4d2bc9-6949-461f-a5de-fdc6e855dbaf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:47.561238 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3c4d2bc9-6949-461f-a5de-fdc6e855dbaf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:47.561732 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3c4d2bc9-6949-461f-a5de-fdc6e855dbaf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:47.562532 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3c4d2bc9-6949-461f-a5de-fdc6e855dbaf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:47.562974 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3c4d2bc9-6949-461f-a5de-fdc6e855dbaf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:47.576699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-3c4d2bc9-6949-461f-a5de-fdc6e855dbaf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] HTTP exception thrown: Instance 61572fbe-ccf7-4ed4-80ab-eda95f187229 could not be found. Nov 02 16:54:47.577317 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3c4d2bc9-6949-461f-a5de-fdc6e855dbaf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Returning 404 to user: Instance 61572fbe-ccf7-4ed4-80ab-eda95f187229 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:54:47.578180 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3c4d2bc9-6949-461f-a5de-fdc6e855dbaf tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 404 len: 111 microversion: 2.1 time: 0.029103 Nov 02 16:54:47.578757 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 556/1131] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:54:47 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:54:47.589060 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-664eabf6-758a-4246-9a13-69f744da7640 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '.version_select at 0x7f112f3c8430>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:47.609347 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-664eabf6-758a-4246-9a13-69f744da7640 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-251418689" status: 202 len: 0 microversion: 2.1 time: 0.025512 Nov 02 16:54:47.609986 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 576/1132] 10.222.0.118 () {58 vars in 1222 bytes} [Tue Nov 2 16:54:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-251418689 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:54:50.573450 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0e7292ec-5e01-431c-96ff-3a4999e966d5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:50.574104 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0e7292ec-5e01-431c-96ff-3a4999e966d5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:50.581227 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0e7292ec-5e01-431c-96ff-3a4999e966d5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:50.581697 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0e7292ec-5e01-431c-96ff-3a4999e966d5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:50.582506 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0e7292ec-5e01-431c-96ff-3a4999e966d5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:50.582968 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0e7292ec-5e01-431c-96ff-3a4999e966d5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:50.596979 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-0e7292ec-5e01-431c-96ff-3a4999e966d5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] HTTP exception thrown: Instance 61572fbe-ccf7-4ed4-80ab-eda95f187229 could not be found. Nov 02 16:54:50.597609 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0e7292ec-5e01-431c-96ff-3a4999e966d5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Returning 404 to user: Instance 61572fbe-ccf7-4ed4-80ab-eda95f187229 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:54:50.598486 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0e7292ec-5e01-431c-96ff-3a4999e966d5 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "DELETE /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 404 len: 111 microversion: 2.1 time: 0.029976 Nov 02 16:54:50.599083 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 557/1133] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:54:50 2021] DELETE /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:54:50.608139 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-01e6c09b-df7e-426c-9a13-f621b9c43c79 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:50.608883 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-01e6c09b-df7e-426c-9a13-f621b9c43c79 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 61572fbe-ccf7-4ed4-80ab-eda95f187229] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:50.616484 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-01e6c09b-df7e-426c-9a13-f621b9c43c79 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:50.616953 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-01e6c09b-df7e-426c-9a13-f621b9c43c79 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:50.617860 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-01e6c09b-df7e-426c-9a13-f621b9c43c79 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:50.618305 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-01e6c09b-df7e-426c-9a13-f621b9c43c79 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:50.634352 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-01e6c09b-df7e-426c-9a13-f621b9c43c79 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] HTTP exception thrown: Instance 61572fbe-ccf7-4ed4-80ab-eda95f187229 could not be found. Nov 02 16:54:50.634996 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-01e6c09b-df7e-426c-9a13-f621b9c43c79 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Returning 404 to user: Instance 61572fbe-ccf7-4ed4-80ab-eda95f187229 could not be found. {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:54:50.636191 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-01e6c09b-df7e-426c-9a13-f621b9c43c79 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229" status: 404 len: 111 microversion: 2.1 time: 0.032112 Nov 02 16:54:50.636828 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 577/1134] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:54:50 2021] GET /compute/v2.1/servers/61572fbe-ccf7-4ed4-80ab-eda95f187229 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:54:51.778890 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-efc2421b-c707-4fbb-b7df-32f67092b44c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:51.779573 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-efc2421b-c707-4fbb-b7df-32f67092b44c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:51.787367 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-efc2421b-c707-4fbb-b7df-32f67092b44c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:51.788462 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-efc2421b-c707-4fbb-b7df-32f67092b44c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:51.789276 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-efc2421b-c707-4fbb-b7df-32f67092b44c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:51.789712 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-efc2421b-c707-4fbb-b7df-32f67092b44c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:51.805350 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-efc2421b-c707-4fbb-b7df-32f67092b44c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] HTTP exception thrown: Instance 1e0809e6-a338-4bc7-8413-86af16333eb4 could not be found. Nov 02 16:54:51.805987 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-efc2421b-c707-4fbb-b7df-32f67092b44c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Returning 404 to user: Instance 1e0809e6-a338-4bc7-8413-86af16333eb4 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:54:51.806875 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-efc2421b-c707-4fbb-b7df-32f67092b44c tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "DELETE /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 404 len: 111 microversion: 2.1 time: 0.032132 Nov 02 16:54:51.807485 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 558/1135] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:54:51 2021] DELETE /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:54:51.817121 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-774b2ee8-ebf5-412a-a459-97b4bdbea199 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:51.817800 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-774b2ee8-ebf5-412a-a459-97b4bdbea199 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] [instance: 1e0809e6-a338-4bc7-8413-86af16333eb4] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:54:51.825426 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-774b2ee8-ebf5-412a-a459-97b4bdbea199 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:51.825893 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-774b2ee8-ebf5-412a-a459-97b4bdbea199 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:51.826701 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-774b2ee8-ebf5-412a-a459-97b4bdbea199 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:54:51.827155 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-774b2ee8-ebf5-412a-a459-97b4bdbea199 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:54:51.841436 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-774b2ee8-ebf5-412a-a459-97b4bdbea199 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] HTTP exception thrown: Instance 1e0809e6-a338-4bc7-8413-86af16333eb4 could not be found. Nov 02 16:54:51.842064 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-774b2ee8-ebf5-412a-a459-97b4bdbea199 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] Returning 404 to user: Instance 1e0809e6-a338-4bc7-8413-86af16333eb4 could not be found. {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:54:51.842942 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-774b2ee8-ebf5-412a-a459-97b4bdbea199 tempest-AttachVolumeTestJSON-201730807 tempest-AttachVolumeTestJSON-201730807-project] 10.222.0.118 "GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4" status: 404 len: 111 microversion: 2.1 time: 0.030112 Nov 02 16:54:51.843588 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 578/1136] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:54:51 2021] GET /compute/v2.1/servers/1e0809e6-a338-4bc7-8413-86af16333eb4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:54:56.993081 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-27a06c4f-bb80-4702-bf22-7b154976cdd0 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Action: 'create', calling method: .version_select at 0x7f112ebe7430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1210453372"}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:57.311925 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-27a06c4f-bb80-4702-bf22-7b154976cdd0 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.464273 Nov 02 16:54:57.312665 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 559/1137] 10.222.0.118 () {60 vars in 1159 bytes} [Tue Nov 2 16:54:56 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 466 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Nov 02 16:54:57.325816 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6a925940-324f-42c0-87de-46ac6f13c4cd tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112f43dee0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:57.383689 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6a925940-324f-42c0-87de-46ac6f13c4cd tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13" status: 200 len: 345 microversion: 2.1 time: 0.062143 Nov 02 16:54:57.384366 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 579/1138] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:54:57 2021] GET /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:58.398979 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-48de733e-f686-4d32-bb69-789ab958984c tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112ebf1280>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:58.458582 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-48de733e-f686-4d32-bb69-789ab958984c tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13" status: 200 len: 346 microversion: 2.1 time: 0.064409 Nov 02 16:54:58.459214 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 560/1139] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:54:58 2021] GET /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13 => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:58.471760 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-94b7f09f-c126-4d6a-a80a-2afbbda7f7f4 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Action: 'create', calling method: .version_select at 0x7f112f625940>, body: {"snapshot": {"volume_id": "1d62c4da-b97e-4768-9440-50fcc3c8af13", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-146783580"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:54:58.619682 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-94b7f09f-c126-4d6a-a80a-2afbbda7f7f4 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.152546 Nov 02 16:54:58.620416 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 580/1140] 10.222.0.118 () {60 vars in 1166 bytes} [Tue Nov 2 16:54:58 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:58.631108 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a7ddb12a-190c-4f65-9e40-453d29d66842 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112ec545e0>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:58.667722 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a7ddb12a-190c-4f65-9e40-453d29d66842 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9" status: 200 len: 286 microversion: 2.1 time: 0.040563 Nov 02 16:54:58.668495 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 561/1141] 10.222.0.118 () {58 vars in 1255 bytes} [Tue Nov 2 16:54:58 2021] GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:58.679444 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6d87b514-55f4-475b-aca5-d007402c99e9 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112f414040>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:58.709317 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6d87b514-55f4-475b-aca5-d007402c99e9 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034271 Nov 02 16:54:58.710502 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 581/1142] 10.222.0.118 () {58 vars in 1144 bytes} [Tue Nov 2 16:54:58 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:58.721098 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-bee6a6b5-50b9-4dc2-bc8e-c1891dd353f4 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112ebce700>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:58.759641 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-bee6a6b5-50b9-4dc2-bc8e-c1891dd353f4 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9" status: 200 len: 286 microversion: 2.1 time: 0.042414 Nov 02 16:54:58.760363 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 562/1143] 10.222.0.118 () {58 vars in 1255 bytes} [Tue Nov 2 16:54:58 2021] GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:54:59.773851 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-21aa817b-db86-4912-b3bd-dc89bc12b63f tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112f67d8b0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:54:59.805480 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-21aa817b-db86-4912-b3bd-dc89bc12b63f tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9" status: 200 len: 286 microversion: 2.1 time: 0.036392 Nov 02 16:54:59.806209 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 582/1144] 10.222.0.118 () {58 vars in 1255 bytes} [Tue Nov 2 16:54:59 2021] GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:00.819371 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ea70f8ff-458a-4933-89a7-fba15f31c6bb tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112ec49310>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:00.851647 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ea70f8ff-458a-4933-89a7-fba15f31c6bb tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9" status: 200 len: 286 microversion: 2.1 time: 0.036608 Nov 02 16:55:00.852311 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 563/1145] 10.222.0.118 () {58 vars in 1255 bytes} [Tue Nov 2 16:55:00 2021] GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:01.864040 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a14c3130-b34c-419f-ba50-e9604e2fa858 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112f4b3700>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:01.896522 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a14c3130-b34c-419f-ba50-e9604e2fa858 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9" status: 200 len: 286 microversion: 2.1 time: 0.036980 Nov 02 16:55:01.897674 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 583/1146] 10.222.0.118 () {58 vars in 1255 bytes} [Tue Nov 2 16:55:01 2021] GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:02.910483 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f89f8825-938c-4af0-97b4-4783e96969c9 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112ec83dc0>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:02.941541 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f89f8825-938c-4af0-97b4-4783e96969c9 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9" status: 200 len: 287 microversion: 2.1 time: 0.035593 Nov 02 16:55:02.942181 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 564/1147] 10.222.0.118 () {58 vars in 1255 bytes} [Tue Nov 2 16:55:02 2021] GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:02.955905 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3d35253f-89bf-4d07-919c-5ac91d28a386 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112f43dee0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:03.014898 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3d35253f-89bf-4d07-919c-5ac91d28a386 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "DELETE /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9" status: 202 len: 0 microversion: 2.1 time: 0.063898 Nov 02 16:55:03.016049 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 584/1148] 10.222.0.118 () {58 vars in 1258 bytes} [Tue Nov 2 16:55:02 2021] DELETE /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:55:03.025656 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-64c4bd86-5e52-4bf8-a951-eb56d19eb146 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112ec491f0>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:03.055856 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-64c4bd86-5e52-4bf8-a951-eb56d19eb146 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9" status: 200 len: 286 microversion: 2.1 time: 0.034848 Nov 02 16:55:03.056534 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 565/1149] 10.222.0.118 () {58 vars in 1255 bytes} [Tue Nov 2 16:55:03 2021] GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:03.976516 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-45bea090-07ff-45c2-9cb7-dc00327008d8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:03.977701 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-45bea090-07ff-45c2-9cb7-dc00327008d8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:03.984448 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-45bea090-07ff-45c2-9cb7-dc00327008d8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:03.984910 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-45bea090-07ff-45c2-9cb7-dc00327008d8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:03.985854 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-45bea090-07ff-45c2-9cb7-dc00327008d8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:03.986676 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-45bea090-07ff-45c2-9cb7-dc00327008d8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:04.015230 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-45bea090-07ff-45c2-9cb7-dc00327008d8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Going to try to terminate instance {{(pid=127649) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:55:04.070396 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b4e60235-b1c3-40b5-88df-26108cb42901 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112ebe7790>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:04.108167 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-b4e60235-b1c3-40b5-88df-26108cb42901 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] HTTP exception thrown: Snapshot e15a9727-3741-4f4a-9f51-eaf8a91da3e9 could not be found. Nov 02 16:55:04.109609 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b4e60235-b1c3-40b5-88df-26108cb42901 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Returning 404 to user: Snapshot e15a9727-3741-4f4a-9f51-eaf8a91da3e9 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:55:04.111083 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b4e60235-b1c3-40b5-88df-26108cb42901 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9" status: 404 len: 111 microversion: 2.1 time: 0.046593 Nov 02 16:55:04.111742 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 566/1150] 10.222.0.118 () {58 vars in 1255 bytes} [Tue Nov 2 16:55:04 2021] GET /compute/v2.1/os-snapshots/e15a9727-3741-4f4a-9f51-eaf8a91da3e9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:55:04.112319 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-45bea090-07ff-45c2-9cb7-dc00327008d8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "DELETE /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 204 len: 0 microversion: 2.1 time: 0.140787 Nov 02 16:55:04.113232 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 585/1151] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:55:03 2021] DELETE /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:55:04.125015 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7ececa46-dcf7-457b-bb04-06d395cfa53e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:04.125659 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7ececa46-dcf7-457b-bb04-06d395cfa53e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:04.126211 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b00b074b-5a40-4691-9493-6e204ad2ef6d tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112f4409d0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:04.133529 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7ececa46-dcf7-457b-bb04-06d395cfa53e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:04.134004 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7ececa46-dcf7-457b-bb04-06d395cfa53e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:04.134848 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7ececa46-dcf7-457b-bb04-06d395cfa53e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:04.135401 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7ececa46-dcf7-457b-bb04-06d395cfa53e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:04.193525 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b00b074b-5a40-4691-9493-6e204ad2ef6d tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "DELETE /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13" status: 202 len: 0 microversion: 2.1 time: 0.072248 Nov 02 16:55:04.194252 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 586/1152] 10.222.0.118 () {58 vars in 1252 bytes} [Tue Nov 2 16:55:04 2021] DELETE /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:55:04.203362 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3c818ae2-a3d7-411f-8f9a-5731bb7a5165 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112f4791f0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:04.272729 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3c818ae2-a3d7-411f-8f9a-5731bb7a5165 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13" status: 200 len: 345 microversion: 2.1 time: 0.072835 Nov 02 16:55:04.273913 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 587/1153] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:55:04 2021] GET /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:55:04.326678 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7ececa46-dcf7-457b-bb04-06d395cfa53e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:04.337043 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7ececa46-dcf7-457b-bb04-06d395cfa53e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1578 microversion: 2.1 time: 0.216254 Nov 02 16:55:04.337706 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 567/1154] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:04 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1578 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:55:05.290855 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-88ddf1c1-6a64-4999-af3e-d2cf63065ec0 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112f414ee0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:05.325947 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-88ddf1c1-6a64-4999-af3e-d2cf63065ec0 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] HTTP exception thrown: Volume 1d62c4da-b97e-4768-9440-50fcc3c8af13 could not be found. Nov 02 16:55:05.326705 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-88ddf1c1-6a64-4999-af3e-d2cf63065ec0 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Returning 404 to user: Volume 1d62c4da-b97e-4768-9440-50fcc3c8af13 could not be found. {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:55:05.327993 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-88ddf1c1-6a64-4999-af3e-d2cf63065ec0 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13" status: 404 len: 109 microversion: 2.1 time: 0.043657 Nov 02 16:55:05.328683 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 588/1155] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:55:05 2021] GET /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:55:05.339964 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e63e16ef-0cb3-4d32-91b1-31c69d871bf0 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112ec54310>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:05.356252 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-277ec0d1-de71-4928-80c4-423f45fba885 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:05.357398 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-277ec0d1-de71-4928-80c4-423f45fba885 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:05.364641 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-277ec0d1-de71-4928-80c4-423f45fba885 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:05.365137 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-277ec0d1-de71-4928-80c4-423f45fba885 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:05.366760 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-277ec0d1-de71-4928-80c4-423f45fba885 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:05.367663 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-277ec0d1-de71-4928-80c4-423f45fba885 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:05.372381 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-e63e16ef-0cb3-4d32-91b1-31c69d871bf0 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] HTTP exception thrown: Volume 1d62c4da-b97e-4768-9440-50fcc3c8af13 could not be found. Nov 02 16:55:05.373046 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e63e16ef-0cb3-4d32-91b1-31c69d871bf0 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Returning 404 to user: Volume 1d62c4da-b97e-4768-9440-50fcc3c8af13 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:55:05.373963 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e63e16ef-0cb3-4d32-91b1-31c69d871bf0 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "DELETE /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13" status: 404 len: 109 microversion: 2.1 time: 0.039464 Nov 02 16:55:05.374630 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 568/1156] 10.222.0.118 () {58 vars in 1252 bytes} [Tue Nov 2 16:55:05 2021] DELETE /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:55:05.383999 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ea01ae08-7a80-46aa-82e9-dcff0744ddd4 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Calling method '.version_select at 0x7f112ec49700>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:05.418597 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-ea01ae08-7a80-46aa-82e9-dcff0744ddd4 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] HTTP exception thrown: Volume 1d62c4da-b97e-4768-9440-50fcc3c8af13 could not be found. Nov 02 16:55:05.419257 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ea01ae08-7a80-46aa-82e9-dcff0744ddd4 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] Returning 404 to user: Volume 1d62c4da-b97e-4768-9440-50fcc3c8af13 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:55:05.420216 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ea01ae08-7a80-46aa-82e9-dcff0744ddd4 tempest-VolumesSnapshotsTestJSON-40310174 tempest-VolumesSnapshotsTestJSON-40310174-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13" status: 404 len: 109 microversion: 2.1 time: 0.040700 Nov 02 16:55:05.420871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 569/1157] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:55:05 2021] GET /compute/v2.1/os-volumes/1d62c4da-b97e-4768-9440-50fcc3c8af13 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 16:55:05.545948 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-277ec0d1-de71-4928-80c4-423f45fba885 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:05.573018 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-277ec0d1-de71-4928-80c4-423f45fba885 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1578 microversion: 2.1 time: 0.221129 Nov 02 16:55:05.574021 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 589/1158] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:05 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1578 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:06.592141 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a9477c60-3c8e-4710-b6f1-f63d817c1ca0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:06.593629 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a9477c60-3c8e-4710-b6f1-f63d817c1ca0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:06.602889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a9477c60-3c8e-4710-b6f1-f63d817c1ca0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:06.603363 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a9477c60-3c8e-4710-b6f1-f63d817c1ca0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:06.604242 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a9477c60-3c8e-4710-b6f1-f63d817c1ca0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:06.604898 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a9477c60-3c8e-4710-b6f1-f63d817c1ca0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:06.890052 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a9477c60-3c8e-4710-b6f1-f63d817c1ca0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:06.905637 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a9477c60-3c8e-4710-b6f1-f63d817c1ca0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1578 microversion: 2.1 time: 0.317238 Nov 02 16:55:06.907520 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 570/1159] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:06 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1578 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:07.270626 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-ffaa14cb-1218-4c0b-b52e-d8fd8b724d71 req-ca41a547-79f9-47f9-ac12-9032886b3ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc9451a-ff42-4d58-8086-84efeda40e0b", "name": "network-vif-deleted", "tag": "38f4c5ac-fd67-4d6a-bcb0-06b8456ad406"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:55:07.270626 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:55:07.270626 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:55:07.289523 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-ffaa14cb-1218-4c0b-b52e-d8fd8b724d71 req-ca41a547-79f9-47f9-ac12-9032886b3ba1 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:07.290122 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-ffaa14cb-1218-4c0b-b52e-d8fd8b724d71 req-ca41a547-79f9-47f9-ac12-9032886b3ba1 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:07.314212 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-ffaa14cb-1218-4c0b-b52e-d8fd8b724d71 req-ca41a547-79f9-47f9-ac12-9032886b3ba1 service nova] Creating event network-vif-deleted:38f4c5ac-fd67-4d6a-bcb0-06b8456ad406 for instance 0cc9451a-ff42-4d58-8086-84efeda40e0b on hv-cinder-77387 Nov 02 16:55:07.330089 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-ffaa14cb-1218-4c0b-b52e-d8fd8b724d71 req-ca41a547-79f9-47f9-ac12-9032886b3ba1 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099389 Nov 02 16:55:07.331563 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 590/1160] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:55:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:07.467290 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b7d0d2f9-df0e-4f09-aa8f-9641b896e669 tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] Action: 'create', calling method: .version_select at 0x7f112ec1a9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-906407814", "metadata": {"Type": "work"}}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:55:07.930373 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b7d0d2f9-df0e-4f09-aa8f-9641b896e669 tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] 10.222.0.118 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.659345 Nov 02 16:55:07.942257 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 571/1161] 10.222.0.118 () {60 vars in 1160 bytes} [Tue Nov 2 16:55:07 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 672 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Nov 02 16:55:07.956683 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1cc0a3a4-f607-4b4d-8631-06fde77565a8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:07.957695 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1cc0a3a4-f607-4b4d-8631-06fde77565a8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:07.967619 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6c7b11c2-f40c-4a81-a0cf-d611c2086154 tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] Calling method '.version_select at 0x7f112ebce550>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:07.982264 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1cc0a3a4-f607-4b4d-8631-06fde77565a8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:07.983696 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1cc0a3a4-f607-4b4d-8631-06fde77565a8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:07.985374 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1cc0a3a4-f607-4b4d-8631-06fde77565a8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:07.987148 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1cc0a3a4-f607-4b4d-8631-06fde77565a8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:08.065284 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1cc0a3a4-f607-4b4d-8631-06fde77565a8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:08.066975 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1cc0a3a4-f607-4b4d-8631-06fde77565a8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:08.068355 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-1cc0a3a4-f607-4b4d-8631-06fde77565a8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lazy-loading 'fault' on Instance uuid 0cc9451a-ff42-4d58-8086-84efeda40e0b {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:55:08.069413 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6c7b11c2-f40c-4a81-a0cf-d611c2086154 tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/6ae3d334-1a1d-4d51-90bc-ae7e879c4d39" status: 200 len: 352 microversion: 2.1 time: 0.125213 Nov 02 16:55:08.069791 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 572/1162] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:55:07 2021] GET /compute/v2.1/os-volumes/6ae3d334-1a1d-4d51-90bc-ae7e879c4d39 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:08.147120 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1cc0a3a4-f607-4b4d-8631-06fde77565a8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:08.161745 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1cc0a3a4-f607-4b4d-8631-06fde77565a8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 200 len: 1232 microversion: 2.1 time: 0.235645 Nov 02 16:55:08.174084 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 591/1163] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:07 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 1232 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:09.085140 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2a027fb3-9453-4613-9500-4cfe9945c08b tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] Calling method '.version_select at 0x7f112ebf13a0>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:09.144547 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2a027fb3-9453-4613-9500-4cfe9945c08b tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/6ae3d334-1a1d-4d51-90bc-ae7e879c4d39" status: 200 len: 353 microversion: 2.1 time: 0.064995 Nov 02 16:55:09.145189 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 573/1164] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:55:09 2021] GET /compute/v2.1/os-volumes/6ae3d334-1a1d-4d51-90bc-ae7e879c4d39 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:09.158416 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-94eae073-3cfa-44d1-9c58-7d596961ea0c tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] Calling method '.version_select at 0x7f1134130dc0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:09.182425 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e53cc031-f9d3-4d7c-95d2-c6d2fb8bf29e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:09.183094 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e53cc031-f9d3-4d7c-95d2-c6d2fb8bf29e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:09.190461 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e53cc031-f9d3-4d7c-95d2-c6d2fb8bf29e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:09.190937 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e53cc031-f9d3-4d7c-95d2-c6d2fb8bf29e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:09.191764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e53cc031-f9d3-4d7c-95d2-c6d2fb8bf29e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:09.192248 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e53cc031-f9d3-4d7c-95d2-c6d2fb8bf29e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:09.208100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-e53cc031-f9d3-4d7c-95d2-c6d2fb8bf29e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] HTTP exception thrown: Instance 0cc9451a-ff42-4d58-8086-84efeda40e0b could not be found. Nov 02 16:55:09.208797 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e53cc031-f9d3-4d7c-95d2-c6d2fb8bf29e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Returning 404 to user: Instance 0cc9451a-ff42-4d58-8086-84efeda40e0b could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:55:09.209799 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e53cc031-f9d3-4d7c-95d2-c6d2fb8bf29e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 404 len: 111 microversion: 2.1 time: 0.033104 Nov 02 16:55:09.211059 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 574/1165] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:09 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 16:55:09.215028 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-94eae073-3cfa-44d1-9c58-7d596961ea0c tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/6ae3d334-1a1d-4d51-90bc-ae7e879c4d39" status: 200 len: 353 microversion: 2.1 time: 0.061074 Nov 02 16:55:09.215793 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 592/1166] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:55:09 2021] GET /compute/v2.1/os-volumes/6ae3d334-1a1d-4d51-90bc-ae7e879c4d39 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:09.232659 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-05192e9f-6f34-443a-8f8f-96a2b4b64193 tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] Calling method '.version_select at 0x7f112ebe7820>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:09.311643 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-05192e9f-6f34-443a-8f8f-96a2b4b64193 tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] 10.222.0.118 "DELETE /compute/v2.1/os-volumes/6ae3d334-1a1d-4d51-90bc-ae7e879c4d39" status: 202 len: 0 microversion: 2.1 time: 0.082911 Nov 02 16:55:09.312711 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 575/1167] 10.222.0.118 () {58 vars in 1252 bytes} [Tue Nov 2 16:55:09 2021] DELETE /compute/v2.1/os-volumes/6ae3d334-1a1d-4d51-90bc-ae7e879c4d39 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:55:09.323121 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-4c0c236a-8ffd-4cb9-a30e-c8e419c048b4 tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] Calling method '.version_select at 0x7f112f66a8b0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:09.343999 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-484120518", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-811681611", "security_groups": [{"name": "tempest-secgroup-smoke-10426531"}], "block_device_mapping_v2": [{"uuid": "57f04180-8872-4240-87cd-910abf7e302a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ac5452b3-7329-433e-af1f-df17acea3828"}]}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:55:09.385957 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-4c0c236a-8ffd-4cb9-a30e-c8e419c048b4 tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/6ae3d334-1a1d-4d51-90bc-ae7e879c4d39" status: 200 len: 352 microversion: 2.1 time: 0.068071 Nov 02 16:55:09.386965 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 593/1168] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:55:09 2021] GET /compute/v2.1/os-volumes/6ae3d334-1a1d-4d51-90bc-ae7e879c4d39 => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:09.476132 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.network.neutron [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] validate_networks() for [('ac5452b3-7329-433e-af1f-df17acea3828', None, None, None, None, None)] {{(pid=127648) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:55:09.888906 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Flavor limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:55:09.889604 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Image limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:55:09.890372 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Flavor pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:55:09.890894 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Image pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:55:09.891326 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:55:09.902843 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:09.903299 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:09.904153 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:09.904775 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:09.926463 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Getting quotas for project f83b31a72c4f4cc78519ed2dc9bdc400. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:55:09.932040 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Getting quotas for user da0989d1d66a4c99b6bf4f1820f7c2e4 and project f83b31a72c4f4cc78519ed2dc9bdc400. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:55:09.998362 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Going to run 1 instances... {{(pid=127648) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:55:10.001030 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57f04180-8872-4240-87cd-910abf7e302a',volume_size=None,volume_type=None)] {{(pid=127648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:55:10.149434 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d4388230-a77f-4a2b-87ac-ae64f457f23f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.809677 Nov 02 16:55:10.150332 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 576/1169] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:55:09 2021] POST /compute/v2.1/servers => generated 406 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:55:10.160880 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0c582e94-fa9d-4c5a-82d5-0d45f4fdad54 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:10.161613 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0c582e94-fa9d-4c5a-82d5-0d45f4fdad54 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:10.221556 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0c582e94-fa9d-4c5a-82d5-0d45f4fdad54 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:10.232000 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0c582e94-fa9d-4c5a-82d5-0d45f4fdad54 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1096 microversion: 2.1 time: 0.075281 Nov 02 16:55:10.236259 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 594/1170] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:10 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1096 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:10.400735 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d69ffdca-bd2a-4d07-b2a7-f3050fba5b58 tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] Calling method '.version_select at 0x7f112ebe7f70>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:10.429594 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-d69ffdca-bd2a-4d07-b2a7-f3050fba5b58 tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] HTTP exception thrown: Volume 6ae3d334-1a1d-4d51-90bc-ae7e879c4d39 could not be found. Nov 02 16:55:10.430448 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-d69ffdca-bd2a-4d07-b2a7-f3050fba5b58 tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] Returning 404 to user: Volume 6ae3d334-1a1d-4d51-90bc-ae7e879c4d39 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:55:10.431594 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-d69ffdca-bd2a-4d07-b2a7-f3050fba5b58 tempest-VolumesGetTestJSON-1747524841 tempest-VolumesGetTestJSON-1747524841-project] 10.222.0.118 "GET /compute/v2.1/os-volumes/6ae3d334-1a1d-4d51-90bc-ae7e879c4d39" status: 404 len: 109 microversion: 2.1 time: 0.036160 Nov 02 16:55:10.432283 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 577/1171] 10.222.0.118 () {58 vars in 1249 bytes} [Tue Nov 2 16:55:10 2021] GET /compute/v2.1/os-volumes/6ae3d334-1a1d-4d51-90bc-ae7e879c4d39 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:55:11.251957 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-59adcaef-b6e8-4f61-845c-6daa47127a06 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:11.251957 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-59adcaef-b6e8-4f61-845c-6daa47127a06 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:11.259425 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-59adcaef-b6e8-4f61-845c-6daa47127a06 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:11.260071 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-59adcaef-b6e8-4f61-845c-6daa47127a06 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:11.261077 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-59adcaef-b6e8-4f61-845c-6daa47127a06 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:11.262147 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-59adcaef-b6e8-4f61-845c-6daa47127a06 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:11.368367 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-59adcaef-b6e8-4f61-845c-6daa47127a06 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:11.378849 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-59adcaef-b6e8-4f61-845c-6daa47127a06 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1212 microversion: 2.1 time: 0.131686 Nov 02 16:55:11.379671 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 595/1172] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:11 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1212 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:55:12.399786 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2aa0df06-e9b0-4d65-bcc3-75ef4e0e29f0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:12.400674 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2aa0df06-e9b0-4d65-bcc3-75ef4e0e29f0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:12.411041 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2aa0df06-e9b0-4d65-bcc3-75ef4e0e29f0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:12.411865 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2aa0df06-e9b0-4d65-bcc3-75ef4e0e29f0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:12.413648 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2aa0df06-e9b0-4d65-bcc3-75ef4e0e29f0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:12.414289 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2aa0df06-e9b0-4d65-bcc3-75ef4e0e29f0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:12.824208 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2aa0df06-e9b0-4d65-bcc3-75ef4e0e29f0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:12.832927 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2aa0df06-e9b0-4d65-bcc3-75ef4e0e29f0 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1266 microversion: 2.1 time: 0.438720 Nov 02 16:55:12.846060 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 578/1173] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:12 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1266 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:13.118082 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 16:55:13.118082 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: Tue Nov 2 16:55:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 16:55:13.454247 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-788023d0-ede3-48a5-8b58-fdf4eec78e25 req-eb634552-bb59-47ca-a7fc-94c404236929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e28e803-80b5-48e8-912a-d47cbeed52e0", "tag": "8985118a-dd23-4724-8375-7570b9e9aad0"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:55:13.465344 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:55:13.465344 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:55:13.516156 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-788023d0-ede3-48a5-8b58-fdf4eec78e25 req-eb634552-bb59-47ca-a7fc-94c404236929 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:13.517154 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-788023d0-ede3-48a5-8b58-fdf4eec78e25 req-eb634552-bb59-47ca-a7fc-94c404236929 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:13.561002 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-788023d0-ede3-48a5-8b58-fdf4eec78e25 req-eb634552-bb59-47ca-a7fc-94c404236929 service nova] Creating event network-changed:8985118a-dd23-4724-8375-7570b9e9aad0 for instance 4e28e803-80b5-48e8-912a-d47cbeed52e0 on hv-cinder-77387 Nov 02 16:55:13.576989 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-788023d0-ede3-48a5-8b58-fdf4eec78e25 req-eb634552-bb59-47ca-a7fc-94c404236929 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136806 Nov 02 16:55:13.579304 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 596/1174] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:55:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:13.874794 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-463907ec-fdd8-45eb-bf6b-e14a7fa33f88 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:13.884301 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-463907ec-fdd8-45eb-bf6b-e14a7fa33f88 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:13.902851 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-463907ec-fdd8-45eb-bf6b-e14a7fa33f88 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:13.903673 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-463907ec-fdd8-45eb-bf6b-e14a7fa33f88 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:13.905760 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-463907ec-fdd8-45eb-bf6b-e14a7fa33f88 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:13.906788 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-463907ec-fdd8-45eb-bf6b-e14a7fa33f88 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:14.334666 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-463907ec-fdd8-45eb-bf6b-e14a7fa33f88 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:14.352998 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-463907ec-fdd8-45eb-bf6b-e14a7fa33f88 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1266 microversion: 2.1 time: 0.486191 Nov 02 16:55:14.355804 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 579/1175] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:13 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1266 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:15.384143 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-51757fbc-0fac-45ab-9485-d7499e55f265 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:15.385024 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-51757fbc-0fac-45ab-9485-d7499e55f265 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:15.396165 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-51757fbc-0fac-45ab-9485-d7499e55f265 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:15.397099 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-51757fbc-0fac-45ab-9485-d7499e55f265 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:15.398584 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-51757fbc-0fac-45ab-9485-d7499e55f265 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:15.399411 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-51757fbc-0fac-45ab-9485-d7499e55f265 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:15.597733 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-51757fbc-0fac-45ab-9485-d7499e55f265 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:15.607268 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-51757fbc-0fac-45ab-9485-d7499e55f265 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1266 microversion: 2.1 time: 0.229686 Nov 02 16:55:15.608003 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 597/1176] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:15 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:16.631084 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-003cf056-7ea5-44f6-b3de-6339d9419df8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:16.632385 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-003cf056-7ea5-44f6-b3de-6339d9419df8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:16.642132 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-003cf056-7ea5-44f6-b3de-6339d9419df8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:16.642776 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-003cf056-7ea5-44f6-b3de-6339d9419df8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:16.643712 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-003cf056-7ea5-44f6-b3de-6339d9419df8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:16.644285 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-003cf056-7ea5-44f6-b3de-6339d9419df8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:16.860240 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-003cf056-7ea5-44f6-b3de-6339d9419df8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:16.874295 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-003cf056-7ea5-44f6-b3de-6339d9419df8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1266 microversion: 2.1 time: 0.251165 Nov 02 16:55:16.875566 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 580/1177] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:16 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:17.893466 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-3c8dc078-3df3-4055-a0c6-2b5b598ae595 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:17.894208 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-3c8dc078-3df3-4055-a0c6-2b5b598ae595 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:17.902423 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3c8dc078-3df3-4055-a0c6-2b5b598ae595 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:17.902893 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3c8dc078-3df3-4055-a0c6-2b5b598ae595 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:17.903708 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3c8dc078-3df3-4055-a0c6-2b5b598ae595 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:17.904156 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-3c8dc078-3df3-4055-a0c6-2b5b598ae595 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:18.053948 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-3c8dc078-3df3-4055-a0c6-2b5b598ae595 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:18.062800 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-3c8dc078-3df3-4055-a0c6-2b5b598ae595 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1266 microversion: 2.1 time: 0.173341 Nov 02 16:55:18.063473 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 598/1178] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:17 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:19.087088 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-aaf8675f-6733-488b-9926-fb260a6b0fd6 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:19.087978 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-aaf8675f-6733-488b-9926-fb260a6b0fd6 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:19.094971 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aaf8675f-6733-488b-9926-fb260a6b0fd6 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:19.095445 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aaf8675f-6733-488b-9926-fb260a6b0fd6 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:19.096297 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aaf8675f-6733-488b-9926-fb260a6b0fd6 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:19.096751 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-aaf8675f-6733-488b-9926-fb260a6b0fd6 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:19.251483 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-aaf8675f-6733-488b-9926-fb260a6b0fd6 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:19.260436 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-aaf8675f-6733-488b-9926-fb260a6b0fd6 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1266 microversion: 2.1 time: 0.177367 Nov 02 16:55:19.261136 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 581/1179] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:19 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:20.279779 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-d5a52f0d-6e67-46e5-8b32-ab85da3b7d25 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:20.281279 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d5a52f0d-6e67-46e5-8b32-ab85da3b7d25 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:20.291405 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d5a52f0d-6e67-46e5-8b32-ab85da3b7d25 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:20.292103 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d5a52f0d-6e67-46e5-8b32-ab85da3b7d25 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:20.293163 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d5a52f0d-6e67-46e5-8b32-ab85da3b7d25 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:20.293802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d5a52f0d-6e67-46e5-8b32-ab85da3b7d25 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:20.435608 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7dc61127-3832-4923-8575-ed44d83fe734 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:20.435608 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7dc61127-3832-4923-8575-ed44d83fe734 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:20.453060 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7dc61127-3832-4923-8575-ed44d83fe734 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:20.454195 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7dc61127-3832-4923-8575-ed44d83fe734 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:20.455800 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7dc61127-3832-4923-8575-ed44d83fe734 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:20.458821 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7dc61127-3832-4923-8575-ed44d83fe734 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:20.485247 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-d5a52f0d-6e67-46e5-8b32-ab85da3b7d25 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:20.495969 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-d5a52f0d-6e67-46e5-8b32-ab85da3b7d25 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1266 microversion: 2.1 time: 0.220110 Nov 02 16:55:20.496758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 599/1180] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:20 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:20.507958 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7dc61127-3832-4923-8575-ed44d83fe734 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079727 Nov 02 16:55:20.509204 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 582/1181] 10.222.0.118 () {60 vars in 1347 bytes} [Tue Nov 2 16:55:20 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:20.576607 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a3cb2c4c-8318-4098-b4df-4a02d4ffd788 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:20.577135 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a3cb2c4c-8318-4098-b4df-4a02d4ffd788 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:20.585315 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a3cb2c4c-8318-4098-b4df-4a02d4ffd788 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:20.585830 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a3cb2c4c-8318-4098-b4df-4a02d4ffd788 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:20.586778 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a3cb2c4c-8318-4098-b4df-4a02d4ffd788 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:20.587132 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a3cb2c4c-8318-4098-b4df-4a02d4ffd788 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:20.614545 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a3cb2c4c-8318-4098-b4df-4a02d4ffd788 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Going to try to terminate instance {{(pid=127649) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:55:20.710866 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a3cb2c4c-8318-4098-b4df-4a02d4ffd788 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "DELETE /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 204 len: 0 microversion: 2.20 time: 0.138269 Nov 02 16:55:20.711415 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 600/1182] 10.222.0.118 () {60 vars in 1284 bytes} [Tue Nov 2 16:55:20 2021] DELETE /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 16:55:20.720619 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7ad25585-5d83-43e8-900b-a169daa585e0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:20.721261 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7ad25585-5d83-43e8-900b-a169daa585e0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:20.728583 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7ad25585-5d83-43e8-900b-a169daa585e0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:20.729059 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7ad25585-5d83-43e8-900b-a169daa585e0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:20.729880 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7ad25585-5d83-43e8-900b-a169daa585e0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:20.730322 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7ad25585-5d83-43e8-900b-a169daa585e0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:20.878038 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7ad25585-5d83-43e8-900b-a169daa585e0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:20.887333 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7ad25585-5d83-43e8-900b-a169daa585e0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:20.889132 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7ad25585-5d83-43e8-900b-a169daa585e0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:20.890401 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7ad25585-5d83-43e8-900b-a169daa585e0 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.174052 Nov 02 16:55:20.891012 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 583/1183] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:55:20 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:55:21.515930 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-424b043d-91ff-41e3-9d55-50f5a49cc10f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:21.516663 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-424b043d-91ff-41e3-9d55-50f5a49cc10f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:21.526029 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-424b043d-91ff-41e3-9d55-50f5a49cc10f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:21.526500 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-424b043d-91ff-41e3-9d55-50f5a49cc10f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:21.527363 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-424b043d-91ff-41e3-9d55-50f5a49cc10f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:21.527835 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-424b043d-91ff-41e3-9d55-50f5a49cc10f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:21.694384 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-424b043d-91ff-41e3-9d55-50f5a49cc10f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:21.703826 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-424b043d-91ff-41e3-9d55-50f5a49cc10f tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1266 microversion: 2.1 time: 0.193154 Nov 02 16:55:21.704515 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 601/1184] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:21 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:21.910420 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a6e8be71-3eac-488f-b45d-9588a2ff979d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:21.911193 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a6e8be71-3eac-488f-b45d-9588a2ff979d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:21.918833 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a6e8be71-3eac-488f-b45d-9588a2ff979d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:21.919292 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a6e8be71-3eac-488f-b45d-9588a2ff979d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:21.920120 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a6e8be71-3eac-488f-b45d-9588a2ff979d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:21.920609 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a6e8be71-3eac-488f-b45d-9588a2ff979d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:22.091082 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a6e8be71-3eac-488f-b45d-9588a2ff979d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:22.101073 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a6e8be71-3eac-488f-b45d-9588a2ff979d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:22.102674 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a6e8be71-3eac-488f-b45d-9588a2ff979d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:22.103977 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a6e8be71-3eac-488f-b45d-9588a2ff979d tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.198203 Nov 02 16:55:22.104642 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 584/1185] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:55:21 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:55:22.722768 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-76ceafa7-9724-4807-9cbc-7c6798786a77 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:22.723600 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-76ceafa7-9724-4807-9cbc-7c6798786a77 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:22.732374 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-76ceafa7-9724-4807-9cbc-7c6798786a77 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:22.732842 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-76ceafa7-9724-4807-9cbc-7c6798786a77 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:22.733677 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-76ceafa7-9724-4807-9cbc-7c6798786a77 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:22.734128 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-76ceafa7-9724-4807-9cbc-7c6798786a77 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:22.892088 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-76ceafa7-9724-4807-9cbc-7c6798786a77 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:22.902035 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-76ceafa7-9724-4807-9cbc-7c6798786a77 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1266 microversion: 2.1 time: 0.183454 Nov 02 16:55:22.902706 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 602/1186] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:22 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:23.124309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3891285d-7ef4-4d66-b5b5-c842aa7b72de tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:23.125066 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3891285d-7ef4-4d66-b5b5-c842aa7b72de tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:23.133660 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3891285d-7ef4-4d66-b5b5-c842aa7b72de tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:23.134134 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3891285d-7ef4-4d66-b5b5-c842aa7b72de tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:23.134968 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3891285d-7ef4-4d66-b5b5-c842aa7b72de tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:23.135425 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3891285d-7ef4-4d66-b5b5-c842aa7b72de tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:23.301582 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3891285d-7ef4-4d66-b5b5-c842aa7b72de tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:23.311441 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3891285d-7ef4-4d66-b5b5-c842aa7b72de tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:23.313039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3891285d-7ef4-4d66-b5b5-c842aa7b72de tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:23.314340 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3891285d-7ef4-4d66-b5b5-c842aa7b72de tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.194971 Nov 02 16:55:23.314957 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 585/1187] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:55:23 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:55:23.920077 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a81598ad-9494-410b-984b-0911099f5396 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:23.920852 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a81598ad-9494-410b-984b-0911099f5396 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:23.928371 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a81598ad-9494-410b-984b-0911099f5396 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:23.928870 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a81598ad-9494-410b-984b-0911099f5396 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:23.929847 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a81598ad-9494-410b-984b-0911099f5396 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:23.930288 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a81598ad-9494-410b-984b-0911099f5396 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:24.079681 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a81598ad-9494-410b-984b-0911099f5396 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:24.088730 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a81598ad-9494-410b-984b-0911099f5396 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1266 microversion: 2.1 time: 0.173043 Nov 02 16:55:24.089372 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 603/1188] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:23 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:24.335377 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-125eaa65-5a35-4336-9305-419c36d7ab67 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:24.336340 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-125eaa65-5a35-4336-9305-419c36d7ab67 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:24.343905 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-125eaa65-5a35-4336-9305-419c36d7ab67 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:24.344414 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-125eaa65-5a35-4336-9305-419c36d7ab67 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:24.345369 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-125eaa65-5a35-4336-9305-419c36d7ab67 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:24.350727 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-125eaa65-5a35-4336-9305-419c36d7ab67 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:24.526264 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-125eaa65-5a35-4336-9305-419c36d7ab67 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:24.538072 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-125eaa65-5a35-4336-9305-419c36d7ab67 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:24.539895 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-125eaa65-5a35-4336-9305-419c36d7ab67 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:24.542248 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-125eaa65-5a35-4336-9305-419c36d7ab67 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1727 microversion: 2.20 time: 0.210908 Nov 02 16:55:24.542248 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 586/1189] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:55:24 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1727 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:55:25.108150 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-24ccbe4b-8305-485a-961f-262207cb475a tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:25.108951 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-24ccbe4b-8305-485a-961f-262207cb475a tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:25.117789 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-24ccbe4b-8305-485a-961f-262207cb475a tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:25.118227 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-24ccbe4b-8305-485a-961f-262207cb475a tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:25.119111 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-24ccbe4b-8305-485a-961f-262207cb475a tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:25.119599 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-24ccbe4b-8305-485a-961f-262207cb475a tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:25.304445 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-24ccbe4b-8305-485a-961f-262207cb475a tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:25.315165 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-24ccbe4b-8305-485a-961f-262207cb475a tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1266 microversion: 2.1 time: 0.211107 Nov 02 16:55:25.316131 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 604/1190] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:25 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:25.561634 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-23190ac5-3dd1-466a-b41d-e3e07445eafc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:25.562285 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-23190ac5-3dd1-466a-b41d-e3e07445eafc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:25.570463 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-23190ac5-3dd1-466a-b41d-e3e07445eafc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:25.570924 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-23190ac5-3dd1-466a-b41d-e3e07445eafc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:25.571737 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-23190ac5-3dd1-466a-b41d-e3e07445eafc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:25.572197 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-23190ac5-3dd1-466a-b41d-e3e07445eafc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:25.664802 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-23190ac5-3dd1-466a-b41d-e3e07445eafc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:25.676048 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-23190ac5-3dd1-466a-b41d-e3e07445eafc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:25.679006 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-23190ac5-3dd1-466a-b41d-e3e07445eafc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef90ae7586e94458bfffbae21ae6b9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc524f131464fe097cff64187071316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:25.680356 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-23190ac5-3dd1-466a-b41d-e3e07445eafc tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 200 len: 1661 microversion: 2.20 time: 0.123092 Nov 02 16:55:25.680998 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 587/1191] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:55:25 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 1661 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 16:55:25.861734 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-a812544a-ee51-49a4-9a81-bf00812ddc2e req-6715be49-0108-4b03-b514-cddaf70a6b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886e9a36-a4f8-44ed-80d0-6a440f49e430", "name": "network-vif-deleted", "tag": "a1262248-0dda-4533-af48-5c1338bb2d4c"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:55:25.864146 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:55:25.864146 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:55:25.880149 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-a812544a-ee51-49a4-9a81-bf00812ddc2e req-6715be49-0108-4b03-b514-cddaf70a6b05 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:25.881604 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-a812544a-ee51-49a4-9a81-bf00812ddc2e req-6715be49-0108-4b03-b514-cddaf70a6b05 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:25.902070 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-a812544a-ee51-49a4-9a81-bf00812ddc2e req-6715be49-0108-4b03-b514-cddaf70a6b05 service nova] Creating event network-vif-deleted:a1262248-0dda-4533-af48-5c1338bb2d4c for instance 886e9a36-a4f8-44ed-80d0-6a440f49e430 on hv-cinder-77387 Nov 02 16:55:25.909524 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-a812544a-ee51-49a4-9a81-bf00812ddc2e req-6715be49-0108-4b03-b514-cddaf70a6b05 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051806 Nov 02 16:55:25.919266 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 605/1192] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:55:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:26.338761 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b2efedeb-794e-47ed-96ea-ca2cad6e4e45 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:26.339578 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b2efedeb-794e-47ed-96ea-ca2cad6e4e45 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:26.351315 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2efedeb-794e-47ed-96ea-ca2cad6e4e45 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:26.352504 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2efedeb-794e-47ed-96ea-ca2cad6e4e45 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:26.354319 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2efedeb-794e-47ed-96ea-ca2cad6e4e45 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:26.355159 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2efedeb-794e-47ed-96ea-ca2cad6e4e45 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:26.566847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b2efedeb-794e-47ed-96ea-ca2cad6e4e45 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:26.574651 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-06dc51dc-cf21-41cd-9cc1-4c8ffb9734ac req-dcf40a11-129e-4fc2-8da0-25f0f7982d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e28e803-80b5-48e8-912a-d47cbeed52e0", "name": "network-vif-plugged", "status": "completed", "tag": "8985118a-dd23-4724-8375-7570b9e9aad0"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:55:26.576114 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:55:26.576114 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:55:26.581481 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b2efedeb-794e-47ed-96ea-ca2cad6e4e45 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1266 microversion: 2.1 time: 0.250709 Nov 02 16:55:26.583513 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 588/1193] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:26 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:26.586184 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-06dc51dc-cf21-41cd-9cc1-4c8ffb9734ac req-dcf40a11-129e-4fc2-8da0-25f0f7982d64 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:26.587139 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-06dc51dc-cf21-41cd-9cc1-4c8ffb9734ac req-dcf40a11-129e-4fc2-8da0-25f0f7982d64 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:26.602501 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-06dc51dc-cf21-41cd-9cc1-4c8ffb9734ac req-dcf40a11-129e-4fc2-8da0-25f0f7982d64 service nova] Creating event network-vif-plugged:8985118a-dd23-4724-8375-7570b9e9aad0 for instance 4e28e803-80b5-48e8-912a-d47cbeed52e0 on hv-cinder-77387 Nov 02 16:55:26.608524 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-06dc51dc-cf21-41cd-9cc1-4c8ffb9734ac req-dcf40a11-129e-4fc2-8da0-25f0f7982d64 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038842 Nov 02 16:55:26.609349 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 606/1194] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:55:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:26.701066 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-748e7623-87f2-437a-9510-bad90cb94855 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:26.701715 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-748e7623-87f2-437a-9510-bad90cb94855 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:26.709180 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-748e7623-87f2-437a-9510-bad90cb94855 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:26.710178 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-748e7623-87f2-437a-9510-bad90cb94855 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:26.711194 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-748e7623-87f2-437a-9510-bad90cb94855 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:26.712469 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-748e7623-87f2-437a-9510-bad90cb94855 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:26.957244 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-748e7623-87f2-437a-9510-bad90cb94855 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] HTTP exception thrown: Instance 886e9a36-a4f8-44ed-80d0-6a440f49e430 could not be found. Nov 02 16:55:26.958055 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-748e7623-87f2-437a-9510-bad90cb94855 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Returning 404 to user: Instance 886e9a36-a4f8-44ed-80d0-6a440f49e430 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:55:26.959116 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-748e7623-87f2-437a-9510-bad90cb94855 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 404 len: 111 microversion: 2.20 time: 0.263161 Nov 02 16:55:26.960044 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 589/1195] 10.222.0.118 () {60 vars in 1281 bytes} [Tue Nov 2 16:55:26 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 111 bytes in 265 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 16:55:26.970292 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-18a279e9-6a00-4a39-a01b-583b5197fc74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '.version_select at 0x7f112f479c10>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:26.991508 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-18a279e9-6a00-4a39-a01b-583b5197fc74 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053567169" status: 204 len: 0 microversion: 2.20 time: 0.025741 Nov 02 16:55:26.992312 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 607/1196] 10.222.0.118 () {60 vars in 1266 bytes} [Tue Nov 2 16:55:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053567169 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 16:55:27.602455 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-fb033806-1741-4f48-b4f5-d9e0acf20829 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:27.603150 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-fb033806-1741-4f48-b4f5-d9e0acf20829 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:27.611177 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fb033806-1741-4f48-b4f5-d9e0acf20829 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:27.611548 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fb033806-1741-4f48-b4f5-d9e0acf20829 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:27.612455 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fb033806-1741-4f48-b4f5-d9e0acf20829 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:27.613033 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-fb033806-1741-4f48-b4f5-d9e0acf20829 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:27.846854 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-fb033806-1741-4f48-b4f5-d9e0acf20829 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:27.856717 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-fb033806-1741-4f48-b4f5-d9e0acf20829 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1266 microversion: 2.1 time: 0.258880 Nov 02 16:55:27.857359 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 590/1197] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:27 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:28.877307 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e83a344d-7209-418f-8428-6e2682fda66c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:28.878105 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e83a344d-7209-418f-8428-6e2682fda66c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:28.885561 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e83a344d-7209-418f-8428-6e2682fda66c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:28.886033 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e83a344d-7209-418f-8428-6e2682fda66c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:28.887126 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e83a344d-7209-418f-8428-6e2682fda66c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:28.887583 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e83a344d-7209-418f-8428-6e2682fda66c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:28.971606 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2a6a65f3-47b4-4be9-9daf-5f104b187c0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:28.973565 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2a6a65f3-47b4-4be9-9daf-5f104b187c0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:28.982250 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2a6a65f3-47b4-4be9-9daf-5f104b187c0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:28.982724 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2a6a65f3-47b4-4be9-9daf-5f104b187c0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:28.983575 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2a6a65f3-47b4-4be9-9daf-5f104b187c0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:28.984022 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2a6a65f3-47b4-4be9-9daf-5f104b187c0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:29.001039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-2a6a65f3-47b4-4be9-9daf-5f104b187c0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] HTTP exception thrown: Instance 886e9a36-a4f8-44ed-80d0-6a440f49e430 could not be found. Nov 02 16:55:29.001913 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2a6a65f3-47b4-4be9-9daf-5f104b187c0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Returning 404 to user: Instance 886e9a36-a4f8-44ed-80d0-6a440f49e430 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:55:29.003099 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2a6a65f3-47b4-4be9-9daf-5f104b187c0b tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "DELETE /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 404 len: 111 microversion: 2.1 time: 0.036370 Nov 02 16:55:29.003728 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 591/1198] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:55:28 2021] DELETE /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 16:55:29.012864 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0744989b-c88a-4494-89ba-052bbf8672a1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:29.013509 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0744989b-c88a-4494-89ba-052bbf8672a1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 886e9a36-a4f8-44ed-80d0-6a440f49e430] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:29.022386 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0744989b-c88a-4494-89ba-052bbf8672a1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:29.022857 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0744989b-c88a-4494-89ba-052bbf8672a1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:29.024098 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0744989b-c88a-4494-89ba-052bbf8672a1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:29.024770 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0744989b-c88a-4494-89ba-052bbf8672a1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:29.043743 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-0744989b-c88a-4494-89ba-052bbf8672a1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] HTTP exception thrown: Instance 886e9a36-a4f8-44ed-80d0-6a440f49e430 could not be found. Nov 02 16:55:29.044644 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0744989b-c88a-4494-89ba-052bbf8672a1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Returning 404 to user: Instance 886e9a36-a4f8-44ed-80d0-6a440f49e430 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:55:29.045829 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0744989b-c88a-4494-89ba-052bbf8672a1 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430" status: 404 len: 111 microversion: 2.1 time: 0.037391 Nov 02 16:55:29.046599 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 592/1199] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:29 2021] GET /compute/v2.1/servers/886e9a36-a4f8-44ed-80d0-6a440f49e430 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 16:55:29.071687 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e83a344d-7209-418f-8428-6e2682fda66c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:29.081417 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e83a344d-7209-418f-8428-6e2682fda66c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1452 microversion: 2.1 time: 0.209512 Nov 02 16:55:29.082306 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 608/1200] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:28 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1452 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:29.100073 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e1670339-1c4d-4002-b15b-4d9be74e71d1 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:29.101814 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e1670339-1c4d-4002-b15b-4d9be74e71d1 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:29.109568 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e1670339-1c4d-4002-b15b-4d9be74e71d1 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:29.110394 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e1670339-1c4d-4002-b15b-4d9be74e71d1 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:29.111561 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e1670339-1c4d-4002-b15b-4d9be74e71d1 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:29.112023 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e1670339-1c4d-4002-b15b-4d9be74e71d1 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:29.287922 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-e1670339-1c4d-4002-b15b-4d9be74e71d1 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:29.298608 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e1670339-1c4d-4002-b15b-4d9be74e71d1 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1452 microversion: 2.1 time: 0.203460 Nov 02 16:55:29.299745 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 593/1201] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:29 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:30.234063 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7fa99e5a-8a62-472d-b7b1-ff74fa9f400e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:30.234851 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7fa99e5a-8a62-472d-b7b1-ff74fa9f400e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:30.245125 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7fa99e5a-8a62-472d-b7b1-ff74fa9f400e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:30.246121 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7fa99e5a-8a62-472d-b7b1-ff74fa9f400e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:30.246540 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7fa99e5a-8a62-472d-b7b1-ff74fa9f400e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:30.246993 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7fa99e5a-8a62-472d-b7b1-ff74fa9f400e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:30.266226 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-7fa99e5a-8a62-472d-b7b1-ff74fa9f400e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] HTTP exception thrown: Instance 3df0bde8-504d-42f2-b162-1fb601b26528 could not be found. Nov 02 16:55:30.266882 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7fa99e5a-8a62-472d-b7b1-ff74fa9f400e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Returning 404 to user: Instance 3df0bde8-504d-42f2-b162-1fb601b26528 could not be found. {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:55:30.267799 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7fa99e5a-8a62-472d-b7b1-ff74fa9f400e tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "DELETE /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 404 len: 111 microversion: 2.1 time: 0.038092 Nov 02 16:55:30.269114 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 609/1202] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:55:30 2021] DELETE /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:55:30.278587 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3619ed03-6665-4137-a906-3a59525527c2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:30.279340 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3619ed03-6665-4137-a906-3a59525527c2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] [instance: 3df0bde8-504d-42f2-b162-1fb601b26528] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:30.288322 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3619ed03-6665-4137-a906-3a59525527c2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:30.289284 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3619ed03-6665-4137-a906-3a59525527c2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:30.290321 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3619ed03-6665-4137-a906-3a59525527c2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:30.290771 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3619ed03-6665-4137-a906-3a59525527c2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:30.310977 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-3619ed03-6665-4137-a906-3a59525527c2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] HTTP exception thrown: Instance 3df0bde8-504d-42f2-b162-1fb601b26528 could not be found. Nov 02 16:55:30.312758 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3619ed03-6665-4137-a906-3a59525527c2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] Returning 404 to user: Instance 3df0bde8-504d-42f2-b162-1fb601b26528 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:55:30.315039 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3619ed03-6665-4137-a906-3a59525527c2 tempest-AttachVolumeShelveTestJSON-2070528336 tempest-AttachVolumeShelveTestJSON-2070528336-project] 10.222.0.118 "GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528" status: 404 len: 111 microversion: 2.1 time: 0.040088 Nov 02 16:55:30.317186 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 594/1203] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:30 2021] GET /compute/v2.1/servers/3df0bde8-504d-42f2-b162-1fb601b26528 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:55:31.995697 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-15a21922-95f2-49d8-9211-f3c9b1875f66 req-c2f0a6b0-23ed-4152-a292-4d3d7dc8d233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e28e803-80b5-48e8-912a-d47cbeed52e0", "tag": "8985118a-dd23-4724-8375-7570b9e9aad0"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:55:31.999286 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:55:31.999286 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:55:32.012826 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-15a21922-95f2-49d8-9211-f3c9b1875f66 req-c2f0a6b0-23ed-4152-a292-4d3d7dc8d233 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:32.013460 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-15a21922-95f2-49d8-9211-f3c9b1875f66 req-c2f0a6b0-23ed-4152-a292-4d3d7dc8d233 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:32.028640 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-15a21922-95f2-49d8-9211-f3c9b1875f66 req-c2f0a6b0-23ed-4152-a292-4d3d7dc8d233 service nova] Creating event network-changed:8985118a-dd23-4724-8375-7570b9e9aad0 for instance 4e28e803-80b5-48e8-912a-d47cbeed52e0 on hv-cinder-77387 Nov 02 16:55:32.035396 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-15a21922-95f2-49d8-9211-f3c9b1875f66 req-c2f0a6b0-23ed-4152-a292-4d3d7dc8d233 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045713 Nov 02 16:55:32.037887 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 610/1204] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:55:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:55:56.660008 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-c833b52c-b986-4d29-89bd-224a2df7fc8b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:55:56.660837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-c833b52c-b986-4d29-89bd-224a2df7fc8b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:56.671030 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c833b52c-b986-4d29-89bd-224a2df7fc8b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:56.671918 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c833b52c-b986-4d29-89bd-224a2df7fc8b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:56.672422 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c833b52c-b986-4d29-89bd-224a2df7fc8b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:56.672857 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-c833b52c-b986-4d29-89bd-224a2df7fc8b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:56.699469 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.objects.instance [None req-c833b52c-b986-4d29-89bd-224a2df7fc8b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lazy-loading 'flavor' on Instance uuid fe6e9f89-7228-463b-b906-679a99ec651c {{(pid=127648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:55:56.790918 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-c833b52c-b986-4d29-89bd-224a2df7fc8b tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "POST /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c/action" status: 202 len: 0 microversion: 2.1 time: 0.134801 Nov 02 16:55:56.791894 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 595/1205] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:55:56 2021] POST /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:55:56.802921 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-d091896c-b9c6-434a-a74d-abe84c398bd5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:56.805505 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d091896c-b9c6-434a-a74d-abe84c398bd5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:56.812827 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d091896c-b9c6-434a-a74d-abe84c398bd5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:56.813286 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d091896c-b9c6-434a-a74d-abe84c398bd5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:56.814123 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d091896c-b9c6-434a-a74d-abe84c398bd5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:56.814609 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d091896c-b9c6-434a-a74d-abe84c398bd5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:56.986523 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-d091896c-b9c6-434a-a74d-abe84c398bd5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:56.995788 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-d091896c-b9c6-434a-a74d-abe84c398bd5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1572 microversion: 2.1 time: 0.198533 Nov 02 16:55:56.996524 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 611/1206] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:56 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1572 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:58.017100 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2aafe44c-504c-4072-a54d-56e3a61465b6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:58.017895 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2aafe44c-504c-4072-a54d-56e3a61465b6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:58.027370 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2aafe44c-504c-4072-a54d-56e3a61465b6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:58.027842 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2aafe44c-504c-4072-a54d-56e3a61465b6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:58.028833 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2aafe44c-504c-4072-a54d-56e3a61465b6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:58.029312 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2aafe44c-504c-4072-a54d-56e3a61465b6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:58.194915 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2aafe44c-504c-4072-a54d-56e3a61465b6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:58.204798 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2aafe44c-504c-4072-a54d-56e3a61465b6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1572 microversion: 2.1 time: 0.193358 Nov 02 16:55:58.205447 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 596/1207] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:58 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1572 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:55:59.224618 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b662dbbb-aae3-4af2-9f86-f18ac3fa5c70 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:55:59.225359 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b662dbbb-aae3-4af2-9f86-f18ac3fa5c70 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:55:59.234421 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b662dbbb-aae3-4af2-9f86-f18ac3fa5c70 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:59.234984 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b662dbbb-aae3-4af2-9f86-f18ac3fa5c70 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:59.235730 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b662dbbb-aae3-4af2-9f86-f18ac3fa5c70 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:55:59.236168 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b662dbbb-aae3-4af2-9f86-f18ac3fa5c70 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:55:59.412909 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b662dbbb-aae3-4af2-9f86-f18ac3fa5c70 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:55:59.425403 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b662dbbb-aae3-4af2-9f86-f18ac3fa5c70 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1572 microversion: 2.1 time: 0.205199 Nov 02 16:55:59.426259 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 612/1208] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:55:59 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1572 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:00.446684 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b954983d-9226-4a7a-9ead-0de40762e9a5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:00.447809 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b954983d-9226-4a7a-9ead-0de40762e9a5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:00.457871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b954983d-9226-4a7a-9ead-0de40762e9a5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:00.458328 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b954983d-9226-4a7a-9ead-0de40762e9a5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:00.459173 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b954983d-9226-4a7a-9ead-0de40762e9a5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:00.459615 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b954983d-9226-4a7a-9ead-0de40762e9a5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:00.627437 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b954983d-9226-4a7a-9ead-0de40762e9a5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:00.637949 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b954983d-9226-4a7a-9ead-0de40762e9a5 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1572 microversion: 2.1 time: 0.196562 Nov 02 16:56:00.638688 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 597/1209] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:00 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1572 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:01.664437 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2976a633-f6cc-45fa-960b-796fddd2e0ef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:01.665195 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2976a633-f6cc-45fa-960b-796fddd2e0ef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:01.673267 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2976a633-f6cc-45fa-960b-796fddd2e0ef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:01.673878 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2976a633-f6cc-45fa-960b-796fddd2e0ef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:01.674875 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2976a633-f6cc-45fa-960b-796fddd2e0ef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:01.675394 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2976a633-f6cc-45fa-960b-796fddd2e0ef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:01.845953 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2976a633-f6cc-45fa-960b-796fddd2e0ef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:01.856623 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2976a633-f6cc-45fa-960b-796fddd2e0ef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1572 microversion: 2.1 time: 0.196917 Nov 02 16:56:01.857321 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 613/1210] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:01 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1572 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:56:02.881546 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9a21f323-76b7-452c-851a-213c3af2f5ba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:02.882900 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9a21f323-76b7-452c-851a-213c3af2f5ba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:02.890408 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9a21f323-76b7-452c-851a-213c3af2f5ba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:02.890868 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9a21f323-76b7-452c-851a-213c3af2f5ba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:02.891679 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9a21f323-76b7-452c-851a-213c3af2f5ba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:02.892119 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9a21f323-76b7-452c-851a-213c3af2f5ba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:03.049345 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9a21f323-76b7-452c-851a-213c3af2f5ba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:03.063435 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9a21f323-76b7-452c-851a-213c3af2f5ba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1572 microversion: 2.1 time: 0.185879 Nov 02 16:56:03.064069 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 598/1211] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:02 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1572 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:04.086220 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-055b7688-a68c-4259-bbfe-d5bbda6eadca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:04.087599 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-055b7688-a68c-4259-bbfe-d5bbda6eadca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:04.095686 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-055b7688-a68c-4259-bbfe-d5bbda6eadca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:04.096156 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-055b7688-a68c-4259-bbfe-d5bbda6eadca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:04.097020 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-055b7688-a68c-4259-bbfe-d5bbda6eadca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:04.097463 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-055b7688-a68c-4259-bbfe-d5bbda6eadca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:04.268471 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-055b7688-a68c-4259-bbfe-d5bbda6eadca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:04.279171 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-055b7688-a68c-4259-bbfe-d5bbda6eadca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1572 microversion: 2.1 time: 0.200236 Nov 02 16:56:04.279939 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 614/1212] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:04 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1572 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:05.300570 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-16c6853f-b7ac-4d56-ab6d-82a66c948d48 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:05.301575 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-16c6853f-b7ac-4d56-ab6d-82a66c948d48 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:05.309877 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-16c6853f-b7ac-4d56-ab6d-82a66c948d48 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:05.310340 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-16c6853f-b7ac-4d56-ab6d-82a66c948d48 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:05.311161 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-16c6853f-b7ac-4d56-ab6d-82a66c948d48 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:05.311604 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-16c6853f-b7ac-4d56-ab6d-82a66c948d48 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:05.474729 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-16c6853f-b7ac-4d56-ab6d-82a66c948d48 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:05.483965 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-16c6853f-b7ac-4d56-ab6d-82a66c948d48 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1572 microversion: 2.1 time: 0.188085 Nov 02 16:56:05.484659 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 599/1213] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:05 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1572 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:06.505086 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-48021dfb-5865-4363-b273-14a9304ce2fd tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:06.505086 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-48021dfb-5865-4363-b273-14a9304ce2fd tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:06.514138 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-48021dfb-5865-4363-b273-14a9304ce2fd tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:06.514603 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-48021dfb-5865-4363-b273-14a9304ce2fd tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:06.515421 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-48021dfb-5865-4363-b273-14a9304ce2fd tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:06.515886 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-48021dfb-5865-4363-b273-14a9304ce2fd tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:06.692777 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-48021dfb-5865-4363-b273-14a9304ce2fd tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:06.703841 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-48021dfb-5865-4363-b273-14a9304ce2fd tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1572 microversion: 2.1 time: 0.203745 Nov 02 16:56:06.705131 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 615/1214] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:06 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1572 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:07.723971 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-20688ce6-eb01-42c0-9c6c-5befd39a5679 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:07.725085 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-20688ce6-eb01-42c0-9c6c-5befd39a5679 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:07.733451 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-20688ce6-eb01-42c0-9c6c-5befd39a5679 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:07.733932 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-20688ce6-eb01-42c0-9c6c-5befd39a5679 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:07.735070 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-20688ce6-eb01-42c0-9c6c-5befd39a5679 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:07.735911 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-20688ce6-eb01-42c0-9c6c-5befd39a5679 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:07.931363 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-20688ce6-eb01-42c0-9c6c-5befd39a5679 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:07.940145 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-20688ce6-eb01-42c0-9c6c-5befd39a5679 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1572 microversion: 2.1 time: 0.220526 Nov 02 16:56:07.940811 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 600/1215] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:07 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1572 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:08.961863 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-5f68345b-c43f-4ce6-8b74-70f0c78532a3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:08.962690 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-5f68345b-c43f-4ce6-8b74-70f0c78532a3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:08.969895 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5f68345b-c43f-4ce6-8b74-70f0c78532a3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:08.970353 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5f68345b-c43f-4ce6-8b74-70f0c78532a3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:08.971176 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5f68345b-c43f-4ce6-8b74-70f0c78532a3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:08.971617 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-5f68345b-c43f-4ce6-8b74-70f0c78532a3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:09.138209 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-5f68345b-c43f-4ce6-8b74-70f0c78532a3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:09.147411 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-5f68345b-c43f-4ce6-8b74-70f0c78532a3 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1572 microversion: 2.1 time: 0.192038 Nov 02 16:56:09.148524 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 616/1216] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:08 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1572 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:10.166577 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2910d6d8-84b4-4cd4-897c-62c8574f5442 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:10.167418 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2910d6d8-84b4-4cd4-897c-62c8574f5442 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:10.175914 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2910d6d8-84b4-4cd4-897c-62c8574f5442 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:10.176444 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2910d6d8-84b4-4cd4-897c-62c8574f5442 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:10.177286 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2910d6d8-84b4-4cd4-897c-62c8574f5442 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:10.178938 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2910d6d8-84b4-4cd4-897c-62c8574f5442 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:10.337481 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2910d6d8-84b4-4cd4-897c-62c8574f5442 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:10.346587 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2910d6d8-84b4-4cd4-897c-62c8574f5442 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1572 microversion: 2.1 time: 0.184525 Nov 02 16:56:10.347224 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 601/1217] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:10 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1572 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:11.365834 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8fc173a6-c51f-46e8-afc6-1e31e55a4596 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:11.367230 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8fc173a6-c51f-46e8-afc6-1e31e55a4596 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:11.375051 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8fc173a6-c51f-46e8-afc6-1e31e55a4596 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:11.375593 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8fc173a6-c51f-46e8-afc6-1e31e55a4596 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:11.376755 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8fc173a6-c51f-46e8-afc6-1e31e55a4596 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:11.377260 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8fc173a6-c51f-46e8-afc6-1e31e55a4596 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:11.542897 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8fc173a6-c51f-46e8-afc6-1e31e55a4596 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:11.551518 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8fc173a6-c51f-46e8-afc6-1e31e55a4596 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1573 microversion: 2.1 time: 0.190419 Nov 02 16:56:11.552206 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 617/1218] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:11 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1573 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:11.570669 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-dba46f03-9efe-4978-a3c9-38c58c5d5626 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:56:11.571402 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-dba46f03-9efe-4978-a3c9-38c58c5d5626 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:11.578948 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dba46f03-9efe-4978-a3c9-38c58c5d5626 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:11.579593 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dba46f03-9efe-4978-a3c9-38c58c5d5626 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:11.580744 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dba46f03-9efe-4978-a3c9-38c58c5d5626 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:11.581238 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-dba46f03-9efe-4978-a3c9-38c58c5d5626 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:11.676482 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-dba46f03-9efe-4978-a3c9-38c58c5d5626 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "POST /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c/action" status: 202 len: 0 microversion: 2.1 time: 0.110770 Nov 02 16:56:11.677306 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 602/1219] 10.222.0.118 () {60 vars in 1282 bytes} [Tue Nov 2 16:56:11 2021] POST /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:56:11.687455 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-36f36fe3-eca7-41bd-9419-a53c32f0a22c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:11.688101 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-36f36fe3-eca7-41bd-9419-a53c32f0a22c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:11.703100 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-36f36fe3-eca7-41bd-9419-a53c32f0a22c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:11.704295 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-36f36fe3-eca7-41bd-9419-a53c32f0a22c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:11.708512 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-36f36fe3-eca7-41bd-9419-a53c32f0a22c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:11.708984 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-36f36fe3-eca7-41bd-9419-a53c32f0a22c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:11.919159 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-36f36fe3-eca7-41bd-9419-a53c32f0a22c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:11.929142 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-36f36fe3-eca7-41bd-9419-a53c32f0a22c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1521 microversion: 2.1 time: 0.245390 Nov 02 16:56:11.930449 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 618/1220] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:11 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:12.951438 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-750d58a0-3a80-4849-b6c8-8043be483600 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:12.952301 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-750d58a0-3a80-4849-b6c8-8043be483600 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:12.959558 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-750d58a0-3a80-4849-b6c8-8043be483600 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:12.960837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-750d58a0-3a80-4849-b6c8-8043be483600 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:12.961925 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-750d58a0-3a80-4849-b6c8-8043be483600 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:12.962420 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-750d58a0-3a80-4849-b6c8-8043be483600 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:13.129610 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-750d58a0-3a80-4849-b6c8-8043be483600 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:13.141753 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-750d58a0-3a80-4849-b6c8-8043be483600 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1579 microversion: 2.1 time: 0.194840 Nov 02 16:56:13.142449 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 603/1221] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:12 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1579 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:14.162108 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-8d2530f7-cfb0-4625-95b7-29cd590e4376 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:14.163556 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-8d2530f7-cfb0-4625-95b7-29cd590e4376 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:14.170869 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8d2530f7-cfb0-4625-95b7-29cd590e4376 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:14.171335 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8d2530f7-cfb0-4625-95b7-29cd590e4376 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:14.172172 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8d2530f7-cfb0-4625-95b7-29cd590e4376 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:14.172751 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-8d2530f7-cfb0-4625-95b7-29cd590e4376 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:14.341366 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-8d2530f7-cfb0-4625-95b7-29cd590e4376 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:14.351344 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-8d2530f7-cfb0-4625-95b7-29cd590e4376 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1579 microversion: 2.1 time: 0.192738 Nov 02 16:56:14.352276 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 619/1222] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:14 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1579 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:14.732313 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-346ac9af-6941-4f32-aab6-12bc55a8b3ba req-923c39bb-850c-470d-b44f-a284bc05f832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6e9f89-7228-463b-b906-679a99ec651c", "name": "network-vif-unplugged", "status": "completed", "tag": "ade707f9-321b-475f-822b-2951865dc9c2"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:56:14.734215 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:56:14.734215 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:56:14.744257 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-346ac9af-6941-4f32-aab6-12bc55a8b3ba req-923c39bb-850c-470d-b44f-a284bc05f832 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:14.744747 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-346ac9af-6941-4f32-aab6-12bc55a8b3ba req-923c39bb-850c-470d-b44f-a284bc05f832 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:14.760074 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-346ac9af-6941-4f32-aab6-12bc55a8b3ba req-923c39bb-850c-470d-b44f-a284bc05f832 service nova] Creating event network-vif-unplugged:ade707f9-321b-475f-822b-2951865dc9c2 for instance fe6e9f89-7228-463b-b906-679a99ec651c on hv-cinder-77387 Nov 02 16:56:14.766272 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-346ac9af-6941-4f32-aab6-12bc55a8b3ba req-923c39bb-850c-470d-b44f-a284bc05f832 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038359 Nov 02 16:56:14.767154 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 604/1223] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:56:14 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:56:15.371291 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-339e4500-4d3e-458f-9213-059372880aef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:15.372230 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-339e4500-4d3e-458f-9213-059372880aef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:15.379488 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-339e4500-4d3e-458f-9213-059372880aef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:15.379950 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-339e4500-4d3e-458f-9213-059372880aef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:15.380821 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-339e4500-4d3e-458f-9213-059372880aef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:15.381325 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-339e4500-4d3e-458f-9213-059372880aef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:15.543503 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-339e4500-4d3e-458f-9213-059372880aef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:15.552057 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-339e4500-4d3e-458f-9213-059372880aef tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1579 microversion: 2.1 time: 0.185809 Nov 02 16:56:15.552732 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 620/1224] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:15 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1579 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:16.572448 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-179a559a-fc7c-4458-b39e-c50c2a8957c7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:16.573416 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-179a559a-fc7c-4458-b39e-c50c2a8957c7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:16.580463 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-179a559a-fc7c-4458-b39e-c50c2a8957c7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:16.581055 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-179a559a-fc7c-4458-b39e-c50c2a8957c7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:16.581872 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-179a559a-fc7c-4458-b39e-c50c2a8957c7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:16.582324 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-179a559a-fc7c-4458-b39e-c50c2a8957c7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:16.768167 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-179a559a-fc7c-4458-b39e-c50c2a8957c7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:16.776870 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-179a559a-fc7c-4458-b39e-c50c2a8957c7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1579 microversion: 2.1 time: 0.209971 Nov 02 16:56:16.777632 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 605/1225] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:16 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1579 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:17.796235 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-e4ff5a5f-e575-4a8b-be14-bc67e73ba48c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:17.797059 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-e4ff5a5f-e575-4a8b-be14-bc67e73ba48c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:17.804291 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4ff5a5f-e575-4a8b-be14-bc67e73ba48c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:17.804766 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4ff5a5f-e575-4a8b-be14-bc67e73ba48c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:17.805605 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4ff5a5f-e575-4a8b-be14-bc67e73ba48c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:17.806105 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-e4ff5a5f-e575-4a8b-be14-bc67e73ba48c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:17.977216 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-e4ff5a5f-e575-4a8b-be14-bc67e73ba48c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:17.987704 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-e4ff5a5f-e575-4a8b-be14-bc67e73ba48c tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1579 microversion: 2.1 time: 0.195772 Nov 02 16:56:17.988468 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 621/1226] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:17 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1579 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:19.007621 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3a252943-557e-4426-b85f-3533991dcf4a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:19.008596 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3a252943-557e-4426-b85f-3533991dcf4a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:19.015813 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a252943-557e-4426-b85f-3533991dcf4a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:19.016316 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a252943-557e-4426-b85f-3533991dcf4a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:19.017141 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a252943-557e-4426-b85f-3533991dcf4a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:19.017595 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3a252943-557e-4426-b85f-3533991dcf4a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:19.191737 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3a252943-557e-4426-b85f-3533991dcf4a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:19.201189 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3a252943-557e-4426-b85f-3533991dcf4a tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1579 microversion: 2.1 time: 0.198143 Nov 02 16:56:19.201841 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 606/1227] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:19 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1579 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:20.219833 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-143172d7-6a72-46ba-84fd-82e0cdb3e4ca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:20.220893 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-143172d7-6a72-46ba-84fd-82e0cdb3e4ca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:20.228373 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-143172d7-6a72-46ba-84fd-82e0cdb3e4ca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:20.228833 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-143172d7-6a72-46ba-84fd-82e0cdb3e4ca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:20.229657 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-143172d7-6a72-46ba-84fd-82e0cdb3e4ca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:20.230097 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-143172d7-6a72-46ba-84fd-82e0cdb3e4ca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:20.398248 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-143172d7-6a72-46ba-84fd-82e0cdb3e4ca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:20.409348 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-143172d7-6a72-46ba-84fd-82e0cdb3e4ca tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1579 microversion: 2.1 time: 0.192563 Nov 02 16:56:20.410381 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 622/1228] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:20 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1579 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:21.428207 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b2a245c7-8486-4a20-a449-7f12f223d789 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:21.429769 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b2a245c7-8486-4a20-a449-7f12f223d789 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:21.438296 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2a245c7-8486-4a20-a449-7f12f223d789 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:21.438772 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2a245c7-8486-4a20-a449-7f12f223d789 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:21.440001 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2a245c7-8486-4a20-a449-7f12f223d789 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:21.440594 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b2a245c7-8486-4a20-a449-7f12f223d789 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:21.611861 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-b2a245c7-8486-4a20-a449-7f12f223d789 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:21.620803 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b2a245c7-8486-4a20-a449-7f12f223d789 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1579 microversion: 2.1 time: 0.197296 Nov 02 16:56:21.621441 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 607/1229] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:21 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1579 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:56:22.640681 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ab3b171b-7594-45f3-8b4c-6c42e1742ada tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:22.641425 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ab3b171b-7594-45f3-8b4c-6c42e1742ada tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:22.650566 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ab3b171b-7594-45f3-8b4c-6c42e1742ada tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:22.650764 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ab3b171b-7594-45f3-8b4c-6c42e1742ada tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:22.651454 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ab3b171b-7594-45f3-8b4c-6c42e1742ada tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:22.651904 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ab3b171b-7594-45f3-8b4c-6c42e1742ada tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:22.825814 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ab3b171b-7594-45f3-8b4c-6c42e1742ada tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:22.837757 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ab3b171b-7594-45f3-8b4c-6c42e1742ada tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1566 microversion: 2.1 time: 0.201432 Nov 02 16:56:22.839114 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 623/1230] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:22 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1566 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:24.849831 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-f88b5384-5808-4e59-8ad3-f55f1bcd73ab req-6d1105a2-1e8d-426f-b97e-ad81ddfb7da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6e9f89-7228-463b-b906-679a99ec651c", "name": "network-vif-plugged", "status": "completed", "tag": "ade707f9-321b-475f-822b-2951865dc9c2"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:56:24.851561 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:56:24.851561 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:56:24.861077 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-f88b5384-5808-4e59-8ad3-f55f1bcd73ab req-6d1105a2-1e8d-426f-b97e-ad81ddfb7da4 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:24.861550 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-f88b5384-5808-4e59-8ad3-f55f1bcd73ab req-6d1105a2-1e8d-426f-b97e-ad81ddfb7da4 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:24.877670 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-f88b5384-5808-4e59-8ad3-f55f1bcd73ab req-6d1105a2-1e8d-426f-b97e-ad81ddfb7da4 service nova] Creating event network-vif-plugged:ade707f9-321b-475f-822b-2951865dc9c2 for instance fe6e9f89-7228-463b-b906-679a99ec651c on hv-cinder-77387 Nov 02 16:56:24.886959 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-f88b5384-5808-4e59-8ad3-f55f1bcd73ab req-6d1105a2-1e8d-426f-b97e-ad81ddfb7da4 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039994 Nov 02 16:56:24.888017 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 608/1231] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:56:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:56:30.231336 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 16:56:30.232228 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: Tue Nov 2 16:56:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 16:56:30.586800 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1795650976", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "networks": [{"uuid": "75cc0cce-da2c-4b3e-b574-65eff930f0d2"}]}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:56:30.833278 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.network.neutron [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] validate_networks() for [('75cc0cce-da2c-4b3e-b574-65eff930f0d2', None, None, None, None, None)] {{(pid=127649) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:56:31.246130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Flavor limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:56:31.247041 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Image limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:56:31.247807 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Flavor pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:56:31.248044 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Image pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:56:31.248739 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:56:31.262142 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:31.262948 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:31.263745 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:31.264229 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:31.284960 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Getting quotas for project b6fbf032a045492497845c4c0918f42f. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:56:31.290284 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Getting quotas for user 6af0f259600643a298f91cc818bb0a47 and project b6fbf032a045492497845c4c0918f42f. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:56:31.302325 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Going to run 1 instances... {{(pid=127649) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:56:31.305058 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:56:31.355643 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c9f0bbb6-f97e-4096-b05a-613a88b4f56a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.773767 Nov 02 16:56:31.356404 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 624/1232] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:56:30 2021] POST /compute/v2.1/servers => generated 382 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:56:31.368578 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-38ce7621-8381-4b5f-b766-5d712328b866 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:31.369387 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-38ce7621-8381-4b5f-b766-5d712328b866 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:31.501901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-38ce7621-8381-4b5f-b766-5d712328b866 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:31.511609 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-38ce7621-8381-4b5f-b766-5d712328b866 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 200 len: 1223 microversion: 2.1 time: 0.148431 Nov 02 16:56:31.520369 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 609/1233] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:31 2021] GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 1223 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:32.530769 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-d4ff282c-c574-4473-9eba-fd2a55077f23 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:32.532438 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d4ff282c-c574-4473-9eba-fd2a55077f23 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:32.541690 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d4ff282c-c574-4473-9eba-fd2a55077f23 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:32.542695 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d4ff282c-c574-4473-9eba-fd2a55077f23 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:32.543646 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d4ff282c-c574-4473-9eba-fd2a55077f23 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:32.544269 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d4ff282c-c574-4473-9eba-fd2a55077f23 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:32.623164 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-d4ff282c-c574-4473-9eba-fd2a55077f23 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:32.631130 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-d4ff282c-c574-4473-9eba-fd2a55077f23 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 200 len: 1283 microversion: 2.1 time: 0.105066 Nov 02 16:56:32.632128 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 625/1234] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:32 2021] GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 1283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:56:33.656154 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f26f4094-70c7-4d97-9176-8ec4a08269ff tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:33.656992 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f26f4094-70c7-4d97-9176-8ec4a08269ff tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:33.665954 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f26f4094-70c7-4d97-9176-8ec4a08269ff tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:33.666422 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f26f4094-70c7-4d97-9176-8ec4a08269ff tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:33.667267 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f26f4094-70c7-4d97-9176-8ec4a08269ff tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:33.667723 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f26f4094-70c7-4d97-9176-8ec4a08269ff tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:34.032672 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f26f4094-70c7-4d97-9176-8ec4a08269ff tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:34.041785 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f26f4094-70c7-4d97-9176-8ec4a08269ff tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 200 len: 1323 microversion: 2.1 time: 0.389729 Nov 02 16:56:34.042435 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 610/1235] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:33 2021] GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 1323 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:34.365143 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-42728967-6a6d-4cc2-83fe-b2b95ae15e7e req-71b4e4e5-089b-4385-8ebf-97ddbff330bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9", "tag": "273abae4-b0d4-47c4-9a46-18ffdde10ba5"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:56:34.369558 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:56:34.369558 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:56:34.380986 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-42728967-6a6d-4cc2-83fe-b2b95ae15e7e req-71b4e4e5-089b-4385-8ebf-97ddbff330bd service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:34.381439 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-42728967-6a6d-4cc2-83fe-b2b95ae15e7e req-71b4e4e5-089b-4385-8ebf-97ddbff330bd service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:34.407965 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-42728967-6a6d-4cc2-83fe-b2b95ae15e7e req-71b4e4e5-089b-4385-8ebf-97ddbff330bd service nova] Creating event network-changed:273abae4-b0d4-47c4-9a46-18ffdde10ba5 for instance 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 on hv-cinder-77387 Nov 02 16:56:34.417978 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-42728967-6a6d-4cc2-83fe-b2b95ae15e7e req-71b4e4e5-089b-4385-8ebf-97ddbff330bd service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056725 Nov 02 16:56:34.419491 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 626/1236] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:56:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:56:35.061677 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-f40c94b2-40c9-4ee8-ae7a-9845aecd2455 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:35.062336 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-f40c94b2-40c9-4ee8-ae7a-9845aecd2455 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:35.069974 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f40c94b2-40c9-4ee8-ae7a-9845aecd2455 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:35.070555 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f40c94b2-40c9-4ee8-ae7a-9845aecd2455 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:35.071387 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f40c94b2-40c9-4ee8-ae7a-9845aecd2455 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:35.071843 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-f40c94b2-40c9-4ee8-ae7a-9845aecd2455 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:35.363763 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-f40c94b2-40c9-4ee8-ae7a-9845aecd2455 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:35.372883 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-f40c94b2-40c9-4ee8-ae7a-9845aecd2455 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 200 len: 1323 microversion: 2.1 time: 0.314869 Nov 02 16:56:35.373348 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 611/1237] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:35 2021] GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 1323 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:36.391863 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-18a97cf3-9d50-46a7-8b9b-9aa6108bb528 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:36.392634 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-18a97cf3-9d50-46a7-8b9b-9aa6108bb528 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:36.399899 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-18a97cf3-9d50-46a7-8b9b-9aa6108bb528 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:36.400408 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-18a97cf3-9d50-46a7-8b9b-9aa6108bb528 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:36.401227 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-18a97cf3-9d50-46a7-8b9b-9aa6108bb528 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:36.401719 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-18a97cf3-9d50-46a7-8b9b-9aa6108bb528 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:36.546796 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-18a97cf3-9d50-46a7-8b9b-9aa6108bb528 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:36.555471 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-18a97cf3-9d50-46a7-8b9b-9aa6108bb528 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 200 len: 1323 microversion: 2.1 time: 0.169082 Nov 02 16:56:36.556111 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 627/1238] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:36 2021] GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 1323 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:37.574026 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-7e94d5dd-9027-4918-9534-08a9fe84a7fd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:37.574772 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-7e94d5dd-9027-4918-9534-08a9fe84a7fd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:37.581465 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e94d5dd-9027-4918-9534-08a9fe84a7fd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:37.581933 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e94d5dd-9027-4918-9534-08a9fe84a7fd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:37.582737 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e94d5dd-9027-4918-9534-08a9fe84a7fd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:37.583188 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-7e94d5dd-9027-4918-9534-08a9fe84a7fd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:37.726497 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-7e94d5dd-9027-4918-9534-08a9fe84a7fd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:37.735072 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-7e94d5dd-9027-4918-9534-08a9fe84a7fd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 200 len: 1323 microversion: 2.1 time: 0.165839 Nov 02 16:56:37.735731 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 612/1239] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:37 2021] GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 1323 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:38.754144 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2b0049f6-95d5-4ef6-85bf-7aa57961ed8f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:38.754822 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-2b0049f6-95d5-4ef6-85bf-7aa57961ed8f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:38.763293 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2b0049f6-95d5-4ef6-85bf-7aa57961ed8f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:38.763779 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2b0049f6-95d5-4ef6-85bf-7aa57961ed8f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:38.764664 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2b0049f6-95d5-4ef6-85bf-7aa57961ed8f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:38.765145 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-2b0049f6-95d5-4ef6-85bf-7aa57961ed8f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:38.933215 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-2b0049f6-95d5-4ef6-85bf-7aa57961ed8f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:38.945309 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2b0049f6-95d5-4ef6-85bf-7aa57961ed8f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 200 len: 1323 microversion: 2.1 time: 0.194326 Nov 02 16:56:38.946185 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 628/1240] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:38 2021] GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:38.949557 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-4c181242-bec1-4629-b063-e12d20748f05 req-bbce3a2c-932c-47e6-8bbb-7bfccdde66f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9", "name": "network-vif-plugged", "status": "completed", "tag": "273abae4-b0d4-47c4-9a46-18ffdde10ba5"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:56:38.953135 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:56:38.953135 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:56:38.963372 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-4c181242-bec1-4629-b063-e12d20748f05 req-bbce3a2c-932c-47e6-8bbb-7bfccdde66f5 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:38.963922 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-4c181242-bec1-4629-b063-e12d20748f05 req-bbce3a2c-932c-47e6-8bbb-7bfccdde66f5 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:38.979953 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-4c181242-bec1-4629-b063-e12d20748f05 req-bbce3a2c-932c-47e6-8bbb-7bfccdde66f5 service nova] Creating event network-vif-plugged:273abae4-b0d4-47c4-9a46-18ffdde10ba5 for instance 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 on hv-cinder-77387 Nov 02 16:56:38.985766 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-4c181242-bec1-4629-b063-e12d20748f05 req-bbce3a2c-932c-47e6-8bbb-7bfccdde66f5 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041465 Nov 02 16:56:38.986522 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 613/1241] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:56:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:56:39.966120 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c510bd37-74ac-41f1-9058-2e7a5d7f30b5 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:39.967059 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c510bd37-74ac-41f1-9058-2e7a5d7f30b5 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:39.975716 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c510bd37-74ac-41f1-9058-2e7a5d7f30b5 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:39.976280 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c510bd37-74ac-41f1-9058-2e7a5d7f30b5 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:39.977407 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c510bd37-74ac-41f1-9058-2e7a5d7f30b5 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:39.978160 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c510bd37-74ac-41f1-9058-2e7a5d7f30b5 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:40.159431 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c510bd37-74ac-41f1-9058-2e7a5d7f30b5 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:40.169561 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c510bd37-74ac-41f1-9058-2e7a5d7f30b5 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 200 len: 1323 microversion: 2.1 time: 0.209165 Nov 02 16:56:40.170220 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 629/1242] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:39 2021] GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 1323 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:56:41.188953 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-da179917-a061-466f-b9c8-b2a898897a9d tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:56:41.189949 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-da179917-a061-466f-b9c8-b2a898897a9d tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:56:41.197074 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-da179917-a061-466f-b9c8-b2a898897a9d tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:41.197549 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-da179917-a061-466f-b9c8-b2a898897a9d tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:41.198388 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-da179917-a061-466f-b9c8-b2a898897a9d tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:56:41.198837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-da179917-a061-466f-b9c8-b2a898897a9d tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:56:41.370701 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-da179917-a061-466f-b9c8-b2a898897a9d tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:56:41.379552 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-da179917-a061-466f-b9c8-b2a898897a9d tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 200 len: 1512 microversion: 2.1 time: 0.195852 Nov 02 16:56:41.380237 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 614/1243] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:56:41 2021] GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:00.802117 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-524b0c7d-7bec-4793-ad24-d892d19f257f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47a57d08-dfe0-432f-9b04-7004a42f2e34", "device": "/dev/sdb"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:57:00.803803 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-524b0c7d-7bec-4793-ad24-d892d19f257f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:00.812425 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-524b0c7d-7bec-4793-ad24-d892d19f257f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:00.812898 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-524b0c7d-7bec-4793-ad24-d892d19f257f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:00.813777 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-524b0c7d-7bec-4793-ad24-d892d19f257f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:00.814246 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-524b0c7d-7bec-4793-ad24-d892d19f257f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:01.110909 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-524b0c7d-7bec-4793-ad24-d892d19f257f tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "POST /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312852 Nov 02 16:57:01.111614 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 630/1244] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:57:00 2021] POST /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:57:25.895678 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-128151086", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-811681611", "security_groups": [{"name": "tempest-secgroup-smoke-10426531"}], "block_device_mapping_v2": [{"uuid": "a2664d22-52a1-4d9b-8e44-99f9140bbe5e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ac5452b3-7329-433e-af1f-df17acea3828"}]}} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:57:26.039320 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.network.neutron [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] validate_networks() for [('ac5452b3-7329-433e-af1f-df17acea3828', None, None, None, None, None)] {{(pid=127648) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:57:26.598752 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Flavor limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:57:26.599190 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Image limits 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:57:26.599693 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Flavor pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:57:26.600155 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Image pref 0:0:0 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:57:26.600612 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.virt.hardware [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:57:26.613334 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:26.613867 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:26.614632 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:26.615075 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:26.634935 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Getting quotas for project f83b31a72c4f4cc78519ed2dc9bdc400. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:57:26.640648 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.quota [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Getting quotas for user da0989d1d66a4c99b6bf4f1820f7c2e4 and project f83b31a72c4f4cc78519ed2dc9bdc400. Resources: {'instances', 'cores', 'ram'} {{(pid=127648) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:57:26.708698 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Going to run 1 instances... {{(pid=127648) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:57:26.711060 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2664d22-52a1-4d9b-8e44-99f9140bbe5e',volume_size=None,volume_type=None)] {{(pid=127648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:57:26.882032 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-bd51af5a-7676-440e-8fe4-7b483db246bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.990742 Nov 02 16:57:26.882917 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 615/1245] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:57:25 2021] POST /compute/v2.1/servers => generated 406 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:57:26.898817 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ad7ef31b-6f43-4236-8d7b-da01c6ba4c1c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:26.899815 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ad7ef31b-6f43-4236-8d7b-da01c6ba4c1c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:26.971559 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ffea2846-242d-44b3-acf3-cf7fb30d73f7 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:26.973054 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ffea2846-242d-44b3-acf3-cf7fb30d73f7 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:26.986163 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ffea2846-242d-44b3-acf3-cf7fb30d73f7 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:26.986532 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ad7ef31b-6f43-4236-8d7b-da01c6ba4c1c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:26.986709 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ffea2846-242d-44b3-acf3-cf7fb30d73f7 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:26.996632 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ffea2846-242d-44b3-acf3-cf7fb30d73f7 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:26.997569 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ad7ef31b-6f43-4236-8d7b-da01c6ba4c1c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1096 microversion: 2.1 time: 0.102383 Nov 02 16:57:26.997878 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ffea2846-242d-44b3-acf3-cf7fb30d73f7 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:26.998068 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 631/1246] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:26 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1096 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:27.118549 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.objects.instance [None req-ffea2846-242d-44b3-acf3-cf7fb30d73f7 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lazy-loading 'services' on Instance uuid 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 {{(pid=127648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:57:27.232414 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ffea2846-242d-44b3-acf3-cf7fb30d73f7 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "DELETE /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9/os-volume_attachments/47a57d08-dfe0-432f-9b04-7004a42f2e34" status: 202 len: 0 microversion: 2.1 time: 0.265352 Nov 02 16:57:27.236275 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 616/1247] 10.222.0.118 () {58 vars in 1420 bytes} [Tue Nov 2 16:57:26 2021] DELETE /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9/os-volume_attachments/47a57d08-dfe0-432f-9b04-7004a42f2e34 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:57:28.017081 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-210c1a16-d411-4363-b13d-95b2001892cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:28.017918 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-210c1a16-d411-4363-b13d-95b2001892cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:28.027741 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-210c1a16-d411-4363-b13d-95b2001892cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:28.028483 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-210c1a16-d411-4363-b13d-95b2001892cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:28.029217 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-210c1a16-d411-4363-b13d-95b2001892cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:28.029693 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-210c1a16-d411-4363-b13d-95b2001892cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:28.106498 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-210c1a16-d411-4363-b13d-95b2001892cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:28.116269 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-210c1a16-d411-4363-b13d-95b2001892cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1194 microversion: 2.1 time: 0.104354 Nov 02 16:57:28.126405 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 632/1248] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:28 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:28.405784 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b74e1fd3-670b-46c4-b4c7-73612b8bbb66 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:28.409162 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b74e1fd3-670b-46c4-b4c7-73612b8bbb66 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:28.423222 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b74e1fd3-670b-46c4-b4c7-73612b8bbb66 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:28.423993 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b74e1fd3-670b-46c4-b4c7-73612b8bbb66 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:28.425549 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b74e1fd3-670b-46c4-b4c7-73612b8bbb66 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:28.426379 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b74e1fd3-670b-46c4-b4c7-73612b8bbb66 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:28.467360 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b74e1fd3-670b-46c4-b4c7-73612b8bbb66 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Going to try to terminate instance {{(pid=127648) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:57:28.570140 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b74e1fd3-670b-46c4-b4c7-73612b8bbb66 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "DELETE /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 204 len: 0 microversion: 2.1 time: 0.171663 Nov 02 16:57:28.573313 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 617/1249] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:57:28 2021] DELETE /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:57:28.584800 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a6ac8104-9769-4f8e-b75d-d137543dd222 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:28.585914 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a6ac8104-9769-4f8e-b75d-d137543dd222 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:28.594807 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a6ac8104-9769-4f8e-b75d-d137543dd222 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:28.595156 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a6ac8104-9769-4f8e-b75d-d137543dd222 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:28.596340 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a6ac8104-9769-4f8e-b75d-d137543dd222 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:28.596814 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a6ac8104-9769-4f8e-b75d-d137543dd222 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:28.791562 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a6ac8104-9769-4f8e-b75d-d137543dd222 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:28.808348 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a6ac8104-9769-4f8e-b75d-d137543dd222 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 200 len: 1518 microversion: 2.1 time: 0.230040 Nov 02 16:57:28.810514 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 633/1250] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:28 2021] GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 1518 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:29.137312 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-418823ef-cb6f-4858-b81b-4877c73f2270 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:29.137970 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-418823ef-cb6f-4858-b81b-4877c73f2270 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:29.145309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-418823ef-cb6f-4858-b81b-4877c73f2270 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:29.145788 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-418823ef-cb6f-4858-b81b-4877c73f2270 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:29.146625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-418823ef-cb6f-4858-b81b-4877c73f2270 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:29.147072 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-418823ef-cb6f-4858-b81b-4877c73f2270 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:29.433144 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-418823ef-cb6f-4858-b81b-4877c73f2270 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:29.448321 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-418823ef-cb6f-4858-b81b-4877c73f2270 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1266 microversion: 2.1 time: 0.316350 Nov 02 16:57:29.449006 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 618/1251] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:29 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:29.838207 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-0de53255-7d6f-4548-a817-b46da7593832 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:29.839373 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-0de53255-7d6f-4548-a817-b46da7593832 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:29.849904 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0de53255-7d6f-4548-a817-b46da7593832 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:29.850360 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0de53255-7d6f-4548-a817-b46da7593832 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:29.851669 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0de53255-7d6f-4548-a817-b46da7593832 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:29.852317 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-0de53255-7d6f-4548-a817-b46da7593832 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:30.511727 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-bda0b368-f6e4-4222-a742-e2331d31a087 req-3a485beb-c58b-451c-bcb1-435e9c89631b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847f7549-4cec-4009-a558-b95fc18ae3cd", "tag": "0a89a30c-7d46-470e-88a8-5643414f6d1b"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:57:30.514149 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:57:30.514149 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:57:30.523909 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-bda0b368-f6e4-4222-a742-e2331d31a087 req-3a485beb-c58b-451c-bcb1-435e9c89631b service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:30.524592 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-bda0b368-f6e4-4222-a742-e2331d31a087 req-3a485beb-c58b-451c-bcb1-435e9c89631b service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:30.539450 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-bda0b368-f6e4-4222-a742-e2331d31a087 req-3a485beb-c58b-451c-bcb1-435e9c89631b service nova] Creating event network-changed:0a89a30c-7d46-470e-88a8-5643414f6d1b for instance 847f7549-4cec-4009-a558-b95fc18ae3cd on hv-cinder-77387 Nov 02 16:57:30.550790 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-bda0b368-f6e4-4222-a742-e2331d31a087 req-3a485beb-c58b-451c-bcb1-435e9c89631b service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155305 Nov 02 16:57:30.553308 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 619/1252] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:57:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:57:30.560210 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-3291f48f-1da4-4554-81d1-e035af213965 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:30.561211 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-3291f48f-1da4-4554-81d1-e035af213965 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:30.579200 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3291f48f-1da4-4554-81d1-e035af213965 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:30.580503 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3291f48f-1da4-4554-81d1-e035af213965 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:30.582040 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-0de53255-7d6f-4548-a817-b46da7593832 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:30.582847 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3291f48f-1da4-4554-81d1-e035af213965 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:30.583585 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-3291f48f-1da4-4554-81d1-e035af213965 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:30.597437 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-0de53255-7d6f-4548-a817-b46da7593832 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 200 len: 1518 microversion: 2.1 time: 0.766612 Nov 02 16:57:30.601413 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 634/1253] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:29 2021] GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 1518 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:31.071156 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-3291f48f-1da4-4554-81d1-e035af213965 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:31.081622 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-3291f48f-1da4-4554-81d1-e035af213965 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1266 microversion: 2.1 time: 0.526499 Nov 02 16:57:31.082897 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 620/1254] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:30 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1266 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:31.620447 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6a5b6042-2c1a-462d-a505-a53bffd93288 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:31.621262 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6a5b6042-2c1a-462d-a505-a53bffd93288 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:31.628945 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6a5b6042-2c1a-462d-a505-a53bffd93288 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:31.629888 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6a5b6042-2c1a-462d-a505-a53bffd93288 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:31.630941 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6a5b6042-2c1a-462d-a505-a53bffd93288 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:31.631591 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6a5b6042-2c1a-462d-a505-a53bffd93288 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:31.724264 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6a5b6042-2c1a-462d-a505-a53bffd93288 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:31.733491 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6a5b6042-2c1a-462d-a505-a53bffd93288 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 200 len: 1476 microversion: 2.1 time: 0.117775 Nov 02 16:57:31.734776 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 635/1255] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:31 2021] GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 1476 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:57:32.101982 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a781a9c8-ee3e-4a30-b060-3dd3d57606cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:32.102764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a781a9c8-ee3e-4a30-b060-3dd3d57606cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:32.112545 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a781a9c8-ee3e-4a30-b060-3dd3d57606cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:32.113026 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a781a9c8-ee3e-4a30-b060-3dd3d57606cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:32.113872 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a781a9c8-ee3e-4a30-b060-3dd3d57606cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:32.114325 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a781a9c8-ee3e-4a30-b060-3dd3d57606cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:32.291998 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a781a9c8-ee3e-4a30-b060-3dd3d57606cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:32.301201 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a781a9c8-ee3e-4a30-b060-3dd3d57606cd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1266 microversion: 2.1 time: 0.204044 Nov 02 16:57:32.304926 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 621/1256] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:32 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:32.584640 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-5b343d0b-f910-4cc8-90c7-018af928b5ab req-026fdb30-b1e1-48ec-b57f-39516ae7728e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9", "name": "network-vif-deleted", "tag": "273abae4-b0d4-47c4-9a46-18ffdde10ba5"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:57:32.586353 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:57:32.586353 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:57:32.596224 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-5b343d0b-f910-4cc8-90c7-018af928b5ab req-026fdb30-b1e1-48ec-b57f-39516ae7728e service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:32.596679 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-5b343d0b-f910-4cc8-90c7-018af928b5ab req-026fdb30-b1e1-48ec-b57f-39516ae7728e service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:32.610797 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-5b343d0b-f910-4cc8-90c7-018af928b5ab req-026fdb30-b1e1-48ec-b57f-39516ae7728e service nova] Creating event network-vif-deleted:273abae4-b0d4-47c4-9a46-18ffdde10ba5 for instance 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 on hv-cinder-77387 Nov 02 16:57:32.616777 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-5b343d0b-f910-4cc8-90c7-018af928b5ab req-026fdb30-b1e1-48ec-b57f-39516ae7728e service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036595 Nov 02 16:57:32.617478 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 636/1257] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:57:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:57:32.752831 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cfc4e82c-a4e6-4d28-a579-13ad5bab9639 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:32.753489 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-cfc4e82c-a4e6-4d28-a579-13ad5bab9639 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:32.761024 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cfc4e82c-a4e6-4d28-a579-13ad5bab9639 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:32.761531 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cfc4e82c-a4e6-4d28-a579-13ad5bab9639 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:32.762355 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cfc4e82c-a4e6-4d28-a579-13ad5bab9639 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:32.763428 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cfc4e82c-a4e6-4d28-a579-13ad5bab9639 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:32.781089 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-cfc4e82c-a4e6-4d28-a579-13ad5bab9639 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] HTTP exception thrown: Instance 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 could not be found. Nov 02 16:57:32.781742 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cfc4e82c-a4e6-4d28-a579-13ad5bab9639 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Returning 404 to user: Instance 3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:57:32.782664 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-cfc4e82c-a4e6-4d28-a579-13ad5bab9639 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9" status: 404 len: 111 microversion: 2.1 time: 0.034189 Nov 02 16:57:32.783315 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 622/1258] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:32 2021] GET /compute/v2.1/servers/3f3782c3-b2f1-4fd5-bcd1-4e11e077c8a9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 16:57:33.320632 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-16736d82-b97e-4af1-9d43-658af5e942e8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:33.321436 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-16736d82-b97e-4af1-9d43-658af5e942e8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:33.331139 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-16736d82-b97e-4af1-9d43-658af5e942e8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:33.331669 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-16736d82-b97e-4af1-9d43-658af5e942e8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:33.332871 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-16736d82-b97e-4af1-9d43-658af5e942e8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:33.333379 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-16736d82-b97e-4af1-9d43-658af5e942e8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:33.487193 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-16736d82-b97e-4af1-9d43-658af5e942e8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:33.497205 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-16736d82-b97e-4af1-9d43-658af5e942e8 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1266 microversion: 2.1 time: 0.181436 Nov 02 16:57:33.497774 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 637/1259] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:33 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:34.515462 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-2129b315-edec-4c70-af7b-38e3d8bb370e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:34.516463 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-2129b315-edec-4c70-af7b-38e3d8bb370e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:34.523722 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2129b315-edec-4c70-af7b-38e3d8bb370e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:34.524235 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2129b315-edec-4c70-af7b-38e3d8bb370e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:34.526077 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2129b315-edec-4c70-af7b-38e3d8bb370e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:34.526077 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-2129b315-edec-4c70-af7b-38e3d8bb370e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:34.688981 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-2129b315-edec-4c70-af7b-38e3d8bb370e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:34.702118 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-2129b315-edec-4c70-af7b-38e3d8bb370e tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1266 microversion: 2.1 time: 0.191053 Nov 02 16:57:34.714309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 623/1260] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:34 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:35.729663 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-6bebe114-e881-4c2e-a49e-13886944309d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:35.730574 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-6bebe114-e881-4c2e-a49e-13886944309d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:35.739797 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6bebe114-e881-4c2e-a49e-13886944309d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:35.740308 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6bebe114-e881-4c2e-a49e-13886944309d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:35.741152 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6bebe114-e881-4c2e-a49e-13886944309d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:35.741628 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-6bebe114-e881-4c2e-a49e-13886944309d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:35.931321 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-6bebe114-e881-4c2e-a49e-13886944309d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:35.943579 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-6bebe114-e881-4c2e-a49e-13886944309d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1266 microversion: 2.1 time: 0.224076 Nov 02 16:57:35.944576 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 638/1261] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:35 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:36.975118 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-581bf80f-9bb8-4110-95df-872fc79b5c21 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:36.976243 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-581bf80f-9bb8-4110-95df-872fc79b5c21 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:36.982959 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-581bf80f-9bb8-4110-95df-872fc79b5c21 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:36.983411 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-581bf80f-9bb8-4110-95df-872fc79b5c21 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:36.984296 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-581bf80f-9bb8-4110-95df-872fc79b5c21 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:36.984743 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-581bf80f-9bb8-4110-95df-872fc79b5c21 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:37.189889 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-581bf80f-9bb8-4110-95df-872fc79b5c21 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:37.200829 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-581bf80f-9bb8-4110-95df-872fc79b5c21 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1266 microversion: 2.1 time: 0.230239 Nov 02 16:57:37.201551 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 624/1262] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:36 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 16:57:38.220361 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-080fdc20-b8d6-43bd-bb32-465169aceeee tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:38.221307 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-080fdc20-b8d6-43bd-bb32-465169aceeee tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:38.229349 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-080fdc20-b8d6-43bd-bb32-465169aceeee tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:38.229811 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-080fdc20-b8d6-43bd-bb32-465169aceeee tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:38.230673 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-080fdc20-b8d6-43bd-bb32-465169aceeee tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:38.231117 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-080fdc20-b8d6-43bd-bb32-465169aceeee tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:38.425348 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-080fdc20-b8d6-43bd-bb32-465169aceeee tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:38.436338 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-080fdc20-b8d6-43bd-bb32-465169aceeee tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1266 microversion: 2.1 time: 0.220256 Nov 02 16:57:38.437019 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 639/1263] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:38 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:39.458625 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-973645f1-d67f-4348-a811-b497a40fbaa4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:39.459429 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-973645f1-d67f-4348-a811-b497a40fbaa4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:39.467354 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-973645f1-d67f-4348-a811-b497a40fbaa4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:39.467825 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-973645f1-d67f-4348-a811-b497a40fbaa4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:39.468699 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-973645f1-d67f-4348-a811-b497a40fbaa4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:39.469153 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-973645f1-d67f-4348-a811-b497a40fbaa4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:39.651831 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-973645f1-d67f-4348-a811-b497a40fbaa4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:39.663102 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-973645f1-d67f-4348-a811-b497a40fbaa4 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1266 microversion: 2.1 time: 0.208423 Nov 02 16:57:39.664146 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 625/1264] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:39 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:40.685903 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-1f21d405-164e-421c-ad53-ef7e85d84bdf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:40.686847 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-1f21d405-164e-421c-ad53-ef7e85d84bdf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:40.697750 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1f21d405-164e-421c-ad53-ef7e85d84bdf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:40.698240 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1f21d405-164e-421c-ad53-ef7e85d84bdf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:40.699126 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1f21d405-164e-421c-ad53-ef7e85d84bdf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:40.699689 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-1f21d405-164e-421c-ad53-ef7e85d84bdf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:40.909857 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-1f21d405-164e-421c-ad53-ef7e85d84bdf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:40.921482 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-1f21d405-164e-421c-ad53-ef7e85d84bdf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1266 microversion: 2.1 time: 0.243051 Nov 02 16:57:40.922281 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 640/1265] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:40 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:41.941288 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-38669cee-bb0d-4e5f-857e-43a3de0c5259 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:41.943138 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-38669cee-bb0d-4e5f-857e-43a3de0c5259 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:41.956136 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-38669cee-bb0d-4e5f-857e-43a3de0c5259 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:41.956712 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-38669cee-bb0d-4e5f-857e-43a3de0c5259 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:41.957986 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-38669cee-bb0d-4e5f-857e-43a3de0c5259 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:41.958611 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-38669cee-bb0d-4e5f-857e-43a3de0c5259 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:42.165361 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-38669cee-bb0d-4e5f-857e-43a3de0c5259 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:42.178543 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-38669cee-bb0d-4e5f-857e-43a3de0c5259 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1266 microversion: 2.1 time: 0.241176 Nov 02 16:57:42.179281 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 626/1266] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:41 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:42.788362 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1127588308", "imageRef": "e621403a-0898-4dce-9fb7-a8fa9a855deb", "flavorRef": "452", "networks": [{"uuid": "75cc0cce-da2c-4b3e-b574-65eff930f0d2"}]}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:57:42.872208 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.network.neutron [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] validate_networks() for [('75cc0cce-da2c-4b3e-b574-65eff930f0d2', None, None, None, None, None)] {{(pid=127649) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 02 16:57:43.201450 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4a37e77a-df3c-45b0-a75f-80eaa4fa8e0c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:43.202786 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4a37e77a-df3c-45b0-a75f-80eaa4fa8e0c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:43.215486 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a37e77a-df3c-45b0-a75f-80eaa4fa8e0c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:43.216065 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a37e77a-df3c-45b0-a75f-80eaa4fa8e0c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:43.217088 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a37e77a-df3c-45b0-a75f-80eaa4fa8e0c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:43.217618 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a37e77a-df3c-45b0-a75f-80eaa4fa8e0c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:43.408594 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Flavor limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 16:57:43.409128 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Image limits 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 16:57:43.409810 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Flavor pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 16:57:43.410392 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Image pref 0:0:0 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 16:57:43.410887 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.virt.hardware [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 16:57:43.423964 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-4a37e77a-df3c-45b0-a75f-80eaa4fa8e0c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:43.426098 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:43.426868 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:43.428622 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:43.429505 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:43.434518 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4a37e77a-df3c-45b0-a75f-80eaa4fa8e0c tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1266 microversion: 2.1 time: 0.238918 Nov 02 16:57:43.435189 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 627/1267] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:43 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:43.457462 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Getting quotas for project b6fbf032a045492497845c4c0918f42f. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 02 16:57:43.463639 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.quota [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Getting quotas for user 6af0f259600643a298f91cc818bb0a47 and project b6fbf032a045492497845c4c0918f42f. Resources: {'instances', 'cores', 'ram'} {{(pid=127649) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 02 16:57:43.480918 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Going to run 1 instances... {{(pid=127649) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 02 16:57:43.483686 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e621403a-0898-4dce-9fb7-a8fa9a855deb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 02 16:57:43.561758 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b7c72270-2380-4661-9500-36588fd85d20 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.781114 Nov 02 16:57:43.562621 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 641/1268] 10.222.0.118 () {60 vars in 1151 bytes} [Tue Nov 2 16:57:42 2021] POST /compute/v2.1/servers => generated 382 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 16:57:43.575254 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-007fc3b3-654e-4eef-bfae-11e7311bdcf8 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:43.575987 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-007fc3b3-654e-4eef-bfae-11e7311bdcf8 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:43.648372 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-007fc3b3-654e-4eef-bfae-11e7311bdcf8 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:43.657335 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-007fc3b3-654e-4eef-bfae-11e7311bdcf8 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 200 len: 1223 microversion: 2.1 time: 0.087676 Nov 02 16:57:43.658392 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 628/1269] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:43 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:43.877888 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-44eb155b-685e-4141-9f17-7c4cf6467434 req-e274f1b0-fbc2-4977-b3f2-9d31222d7a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847f7549-4cec-4009-a558-b95fc18ae3cd", "name": "network-vif-plugged", "status": "completed", "tag": "0a89a30c-7d46-470e-88a8-5643414f6d1b"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:57:43.880868 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:57:43.880868 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:57:43.892310 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-44eb155b-685e-4141-9f17-7c4cf6467434 req-e274f1b0-fbc2-4977-b3f2-9d31222d7a1d service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:43.892477 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-44eb155b-685e-4141-9f17-7c4cf6467434 req-e274f1b0-fbc2-4977-b3f2-9d31222d7a1d service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:43.922177 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-44eb155b-685e-4141-9f17-7c4cf6467434 req-e274f1b0-fbc2-4977-b3f2-9d31222d7a1d service nova] Creating event network-vif-plugged:0a89a30c-7d46-470e-88a8-5643414f6d1b for instance 847f7549-4cec-4009-a558-b95fc18ae3cd on hv-cinder-77387 Nov 02 16:57:43.928684 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-44eb155b-685e-4141-9f17-7c4cf6467434 req-e274f1b0-fbc2-4977-b3f2-9d31222d7a1d service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055873 Nov 02 16:57:43.929466 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 642/1270] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:57:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:57:44.457375 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-94fdddc1-761d-41a1-9de7-7a2a58ef8d6d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:44.458111 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-94fdddc1-761d-41a1-9de7-7a2a58ef8d6d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:44.466309 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-94fdddc1-761d-41a1-9de7-7a2a58ef8d6d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:44.466782 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-94fdddc1-761d-41a1-9de7-7a2a58ef8d6d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:44.467638 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-94fdddc1-761d-41a1-9de7-7a2a58ef8d6d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:44.468081 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-94fdddc1-761d-41a1-9de7-7a2a58ef8d6d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:44.660096 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-94fdddc1-761d-41a1-9de7-7a2a58ef8d6d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:44.671223 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-94fdddc1-761d-41a1-9de7-7a2a58ef8d6d tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1266 microversion: 2.1 time: 0.218124 Nov 02 16:57:44.671901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 629/1271] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:44 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:44.683907 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-dca0c2b4-21f4-4e6c-8a12-c8912089eb29 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:44.684719 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-dca0c2b4-21f4-4e6c-8a12-c8912089eb29 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:44.693151 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dca0c2b4-21f4-4e6c-8a12-c8912089eb29 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:44.693611 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dca0c2b4-21f4-4e6c-8a12-c8912089eb29 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:44.694495 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dca0c2b4-21f4-4e6c-8a12-c8912089eb29 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:44.695005 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-dca0c2b4-21f4-4e6c-8a12-c8912089eb29 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:44.784523 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-dca0c2b4-21f4-4e6c-8a12-c8912089eb29 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:44.795965 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-dca0c2b4-21f4-4e6c-8a12-c8912089eb29 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 200 len: 1275 microversion: 2.1 time: 0.118054 Nov 02 16:57:44.808061 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 643/1272] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:44 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:45.699720 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-8d3902de-3c9b-4ba2-9ad1-817c52ebc92b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:45.700756 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-8d3902de-3c9b-4ba2-9ad1-817c52ebc92b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:45.711844 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8d3902de-3c9b-4ba2-9ad1-817c52ebc92b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:45.713249 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8d3902de-3c9b-4ba2-9ad1-817c52ebc92b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:45.714812 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8d3902de-3c9b-4ba2-9ad1-817c52ebc92b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:45.715871 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-8d3902de-3c9b-4ba2-9ad1-817c52ebc92b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:45.816439 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-b7ef5452-6072-416b-b7d8-8d0013ab298a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:45.818027 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-b7ef5452-6072-416b-b7d8-8d0013ab298a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:45.826572 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7ef5452-6072-416b-b7d8-8d0013ab298a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:45.827413 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7ef5452-6072-416b-b7d8-8d0013ab298a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:45.828304 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7ef5452-6072-416b-b7d8-8d0013ab298a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:45.828766 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-b7ef5452-6072-416b-b7d8-8d0013ab298a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:45.911043 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-b7ef5452-6072-416b-b7d8-8d0013ab298a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:45.919897 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-b7ef5452-6072-416b-b7d8-8d0013ab298a tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 200 len: 1281 microversion: 2.1 time: 0.108207 Nov 02 16:57:45.920623 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 644/1273] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:45 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 1281 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:46.011476 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-8d3902de-3c9b-4ba2-9ad1-817c52ebc92b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:46.020648 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-8d3902de-3c9b-4ba2-9ad1-817c52ebc92b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1453 microversion: 2.1 time: 0.327905 Nov 02 16:57:46.021441 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 630/1274] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:45 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1453 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:46.044298 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-c6a374d3-e0dd-41e0-87d3-7f1a1e5072f9 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:46.045176 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-c6a374d3-e0dd-41e0-87d3-7f1a1e5072f9 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:46.054043 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c6a374d3-e0dd-41e0-87d3-7f1a1e5072f9 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:46.054530 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c6a374d3-e0dd-41e0-87d3-7f1a1e5072f9 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:46.055546 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c6a374d3-e0dd-41e0-87d3-7f1a1e5072f9 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:46.057334 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-c6a374d3-e0dd-41e0-87d3-7f1a1e5072f9 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:46.230856 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-c6a374d3-e0dd-41e0-87d3-7f1a1e5072f9 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:46.239734 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-c6a374d3-e0dd-41e0-87d3-7f1a1e5072f9 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1453 microversion: 2.1 time: 0.204142 Nov 02 16:57:46.244872 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 645/1275] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:46 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1453 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:46.958282 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-10bc9cfd-b87e-4341-8211-fa57b41a442b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:46.961672 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-10bc9cfd-b87e-4341-8211-fa57b41a442b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:46.966039 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-cad8c4dd-30d8-4b5d-85df-43d4b4626600 req-21e24088-f168-4c2e-8e8a-92895465971e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "009e55d9-e974-4936-aabc-4c2da4a531c0", "tag": "64619a3d-b4d4-4e91-a2c7-b4e7a0d9e71c"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:57:46.978967 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:57:46.978967 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:57:46.992858 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-10bc9cfd-b87e-4341-8211-fa57b41a442b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:46.993777 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-10bc9cfd-b87e-4341-8211-fa57b41a442b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:46.995133 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-10bc9cfd-b87e-4341-8211-fa57b41a442b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:46.996074 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-10bc9cfd-b87e-4341-8211-fa57b41a442b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:47.001218 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-cad8c4dd-30d8-4b5d-85df-43d4b4626600 req-21e24088-f168-4c2e-8e8a-92895465971e service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:47.002014 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-cad8c4dd-30d8-4b5d-85df-43d4b4626600 req-21e24088-f168-4c2e-8e8a-92895465971e service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:47.017132 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-cad8c4dd-30d8-4b5d-85df-43d4b4626600 req-21e24088-f168-4c2e-8e8a-92895465971e service nova] Creating event network-changed:64619a3d-b4d4-4e91-a2c7-b4e7a0d9e71c for instance 009e55d9-e974-4936-aabc-4c2da4a531c0 on hv-cinder-77387 Nov 02 16:57:47.025280 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-cad8c4dd-30d8-4b5d-85df-43d4b4626600 req-21e24088-f168-4c2e-8e8a-92895465971e service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078823 Nov 02 16:57:47.026510 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 646/1276] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:57:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:57:47.244778 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-10bc9cfd-b87e-4341-8211-fa57b41a442b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:47.262214 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-10bc9cfd-b87e-4341-8211-fa57b41a442b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 200 len: 1323 microversion: 2.1 time: 0.326022 Nov 02 16:57:47.263668 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 631/1277] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:46 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 1323 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:48.248795 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-b14fde14-9b4f-4e59-9e51-d0895650cc14 req-636974c8-c71a-4de2-8c55-3aad296dd10c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847f7549-4cec-4009-a558-b95fc18ae3cd", "tag": "0a89a30c-7d46-470e-88a8-5643414f6d1b"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:57:48.250468 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:57:48.250468 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:57:48.259945 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-b14fde14-9b4f-4e59-9e51-d0895650cc14 req-636974c8-c71a-4de2-8c55-3aad296dd10c service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:48.260623 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-b14fde14-9b4f-4e59-9e51-d0895650cc14 req-636974c8-c71a-4de2-8c55-3aad296dd10c service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:48.273599 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-b14fde14-9b4f-4e59-9e51-d0895650cc14 req-636974c8-c71a-4de2-8c55-3aad296dd10c service nova] Creating event network-changed:0a89a30c-7d46-470e-88a8-5643414f6d1b for instance 847f7549-4cec-4009-a558-b95fc18ae3cd on hv-cinder-77387 Nov 02 16:57:48.280058 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-b14fde14-9b4f-4e59-9e51-d0895650cc14 req-636974c8-c71a-4de2-8c55-3aad296dd10c service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112289 Nov 02 16:57:48.281201 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 647/1278] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:57:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:57:48.282113 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-880b4466-b5de-410e-ba31-a9081446c6cd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:48.282963 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-880b4466-b5de-410e-ba31-a9081446c6cd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:48.291402 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-880b4466-b5de-410e-ba31-a9081446c6cd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:48.291879 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-880b4466-b5de-410e-ba31-a9081446c6cd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:48.292945 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-880b4466-b5de-410e-ba31-a9081446c6cd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:48.293604 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-880b4466-b5de-410e-ba31-a9081446c6cd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:48.535728 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-880b4466-b5de-410e-ba31-a9081446c6cd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:48.544943 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-880b4466-b5de-410e-ba31-a9081446c6cd tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 200 len: 1323 microversion: 2.1 time: 0.266976 Nov 02 16:57:48.546001 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 632/1279] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:48 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:49.565049 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-a4dd2483-9af7-4aa3-b2b8-936334d6568c tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:49.565776 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-a4dd2483-9af7-4aa3-b2b8-936334d6568c tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:49.573611 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a4dd2483-9af7-4aa3-b2b8-936334d6568c tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:49.574087 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a4dd2483-9af7-4aa3-b2b8-936334d6568c tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:49.574939 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a4dd2483-9af7-4aa3-b2b8-936334d6568c tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:49.575400 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-a4dd2483-9af7-4aa3-b2b8-936334d6568c tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:49.741886 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-a4dd2483-9af7-4aa3-b2b8-936334d6568c tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:49.751594 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-a4dd2483-9af7-4aa3-b2b8-936334d6568c tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 200 len: 1323 microversion: 2.1 time: 0.191726 Nov 02 16:57:49.752312 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 648/1280] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:49 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:50.770468 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-051d31d1-8fc0-4a79-93e0-03c4df8f0939 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:50.771265 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-051d31d1-8fc0-4a79-93e0-03c4df8f0939 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:50.779219 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-051d31d1-8fc0-4a79-93e0-03c4df8f0939 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:50.779694 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-051d31d1-8fc0-4a79-93e0-03c4df8f0939 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:50.780566 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-051d31d1-8fc0-4a79-93e0-03c4df8f0939 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:50.781021 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-051d31d1-8fc0-4a79-93e0-03c4df8f0939 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:50.934057 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-051d31d1-8fc0-4a79-93e0-03c4df8f0939 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:50.943118 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-051d31d1-8fc0-4a79-93e0-03c4df8f0939 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 200 len: 1323 microversion: 2.1 time: 0.176610 Nov 02 16:57:50.943585 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 633/1281] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:50 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 1323 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:51.963817 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9ab4d0b0-7cf7-4074-abf2-678b0d0c2efe tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:51.964864 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9ab4d0b0-7cf7-4074-abf2-678b0d0c2efe tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:51.975376 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-f469e351-f733-4c77-ba37-d3e8d5e7a1e5 req-01aa36f5-eb89-46a0-900f-6b4f751834df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "009e55d9-e974-4936-aabc-4c2da4a531c0", "name": "network-vif-plugged", "status": "completed", "tag": "64619a3d-b4d4-4e91-a2c7-b4e7a0d9e71c"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:57:51.977759 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9ab4d0b0-7cf7-4074-abf2-678b0d0c2efe tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:51.978237 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9ab4d0b0-7cf7-4074-abf2-678b0d0c2efe tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:51.979744 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:57:51.979744 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:57:51.980221 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9ab4d0b0-7cf7-4074-abf2-678b0d0c2efe tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:51.981155 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9ab4d0b0-7cf7-4074-abf2-678b0d0c2efe tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:51.991053 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-f469e351-f733-4c77-ba37-d3e8d5e7a1e5 req-01aa36f5-eb89-46a0-900f-6b4f751834df service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:51.991561 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-f469e351-f733-4c77-ba37-d3e8d5e7a1e5 req-01aa36f5-eb89-46a0-900f-6b4f751834df service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:52.006066 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-f469e351-f733-4c77-ba37-d3e8d5e7a1e5 req-01aa36f5-eb89-46a0-900f-6b4f751834df service nova] Creating event network-vif-plugged:64619a3d-b4d4-4e91-a2c7-b4e7a0d9e71c for instance 009e55d9-e974-4936-aabc-4c2da4a531c0 on hv-cinder-77387 Nov 02 16:57:52.013275 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-f469e351-f733-4c77-ba37-d3e8d5e7a1e5 req-01aa36f5-eb89-46a0-900f-6b4f751834df service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133491 Nov 02 16:57:52.014248 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 649/1282] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:57:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:57:52.156027 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-9ab4d0b0-7cf7-4074-abf2-678b0d0c2efe tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:52.166599 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9ab4d0b0-7cf7-4074-abf2-678b0d0c2efe tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 200 len: 1323 microversion: 2.1 time: 0.208586 Nov 02 16:57:52.167702 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 634/1283] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:51 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 1323 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:53.190427 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-d1e371fa-1415-4090-bce4-75f21f0f1748 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:53.192296 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-d1e371fa-1415-4090-bce4-75f21f0f1748 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:53.202455 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d1e371fa-1415-4090-bce4-75f21f0f1748 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:53.202455 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d1e371fa-1415-4090-bce4-75f21f0f1748 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:53.205256 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d1e371fa-1415-4090-bce4-75f21f0f1748 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:53.205256 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-d1e371fa-1415-4090-bce4-75f21f0f1748 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:53.339817 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-e4743da1-dd16-41f8-b4be-13aba54b8123 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:53.341324 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e4743da1-dd16-41f8-b4be-13aba54b8123 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:53.355999 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4743da1-dd16-41f8-b4be-13aba54b8123 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:53.357036 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4743da1-dd16-41f8-b4be-13aba54b8123 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:53.358243 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4743da1-dd16-41f8-b4be-13aba54b8123 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:53.358977 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-e4743da1-dd16-41f8-b4be-13aba54b8123 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:53.392000 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-e4743da1-dd16-41f8-b4be-13aba54b8123 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Going to try to terminate instance {{(pid=127648) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:57:53.405325 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-d1e371fa-1415-4090-bce4-75f21f0f1748 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:53.418786 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-d1e371fa-1415-4090-bce4-75f21f0f1748 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 200 len: 1323 microversion: 2.1 time: 0.235131 Nov 02 16:57:53.428827 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 650/1284] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:53 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 1323 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:53.428827 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-c136853b-ea34-47f1-91c5-a2db0a9e1a22 req-5cfe2081-515d-45bd-a27d-f819147d32ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6e9f89-7228-463b-b906-679a99ec651c", "tag": "ade707f9-321b-475f-822b-2951865dc9c2"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:57:53.430293 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:57:53.430293 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:57:53.438714 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-c136853b-ea34-47f1-91c5-a2db0a9e1a22 req-5cfe2081-515d-45bd-a27d-f819147d32ee service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:53.439178 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-c136853b-ea34-47f1-91c5-a2db0a9e1a22 req-5cfe2081-515d-45bd-a27d-f819147d32ee service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:53.453716 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-c136853b-ea34-47f1-91c5-a2db0a9e1a22 req-5cfe2081-515d-45bd-a27d-f819147d32ee service nova] Creating event network-changed:ade707f9-321b-475f-822b-2951865dc9c2 for instance fe6e9f89-7228-463b-b906-679a99ec651c on hv-cinder-77387 Nov 02 16:57:53.460234 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-c136853b-ea34-47f1-91c5-a2db0a9e1a22 req-5cfe2081-515d-45bd-a27d-f819147d32ee service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035559 Nov 02 16:57:53.460932 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 651/1285] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:57:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:57:53.517652 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-e4743da1-dd16-41f8-b4be-13aba54b8123 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "DELETE /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 204 len: 0 microversion: 2.1 time: 0.186540 Nov 02 16:57:53.519239 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 635/1286] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:57:53 2021] DELETE /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:57:53.530528 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-420996a5-ed67-4bde-bd77-6044efd22eb6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:53.531735 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-420996a5-ed67-4bde-bd77-6044efd22eb6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:53.539430 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-420996a5-ed67-4bde-bd77-6044efd22eb6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:53.540566 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-420996a5-ed67-4bde-bd77-6044efd22eb6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:53.541759 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-420996a5-ed67-4bde-bd77-6044efd22eb6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:53.542505 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-420996a5-ed67-4bde-bd77-6044efd22eb6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:53.742148 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-420996a5-ed67-4bde-bd77-6044efd22eb6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:53.751650 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-420996a5-ed67-4bde-bd77-6044efd22eb6 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1572 microversion: 2.1 time: 0.225746 Nov 02 16:57:53.752566 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 652/1287] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:53 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1572 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:54.442598 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-a0426da3-4af8-48f0-9e35-990795c87448 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:54.443560 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-a0426da3-4af8-48f0-9e35-990795c87448 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:54.451704 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0426da3-4af8-48f0-9e35-990795c87448 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:54.452137 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0426da3-4af8-48f0-9e35-990795c87448 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:54.452923 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0426da3-4af8-48f0-9e35-990795c87448 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:54.453368 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-a0426da3-4af8-48f0-9e35-990795c87448 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:54.619630 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-a0426da3-4af8-48f0-9e35-990795c87448 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:54.630564 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-a0426da3-4af8-48f0-9e35-990795c87448 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 200 len: 1513 microversion: 2.1 time: 0.192997 Nov 02 16:57:54.631578 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 636/1288] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:54 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:54.652243 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-64735bb6-722a-45af-a7b9-65ee8d700b45 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12bb19ba-3773-45c7-8d67-1df6dac95130", "device": "/dev/sdb"}} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:57:54.653508 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-64735bb6-722a-45af-a7b9-65ee8d700b45 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:54.661531 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-64735bb6-722a-45af-a7b9-65ee8d700b45 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:54.662006 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-64735bb6-722a-45af-a7b9-65ee8d700b45 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:54.662824 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-64735bb6-722a-45af-a7b9-65ee8d700b45 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:54.663271 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-64735bb6-722a-45af-a7b9-65ee8d700b45 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:54.771463 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-ced2a92d-8868-4711-a79b-5d11df91daba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:54.772447 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-ced2a92d-8868-4711-a79b-5d11df91daba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:54.781498 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ced2a92d-8868-4711-a79b-5d11df91daba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:54.782377 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ced2a92d-8868-4711-a79b-5d11df91daba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:54.783709 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ced2a92d-8868-4711-a79b-5d11df91daba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:54.784197 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-ced2a92d-8868-4711-a79b-5d11df91daba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:54.961059 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-ced2a92d-8868-4711-a79b-5d11df91daba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:54.964535 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-64735bb6-722a-45af-a7b9-65ee8d700b45 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "POST /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317341 Nov 02 16:57:54.965637 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 653/1289] 10.222.0.118 () {60 vars in 1327 bytes} [Tue Nov 2 16:57:54 2021] POST /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:57:54.976061 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-ced2a92d-8868-4711-a79b-5d11df91daba tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1453 microversion: 2.1 time: 0.208585 Nov 02 16:57:54.976658 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 637/1290] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:54 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1453 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:55.996237 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-478e396a-76cb-4daa-9108-1dc6d1dced1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:55.996994 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-478e396a-76cb-4daa-9108-1dc6d1dced1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:56.004538 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-478e396a-76cb-4daa-9108-1dc6d1dced1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:56.005028 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-478e396a-76cb-4daa-9108-1dc6d1dced1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:56.005834 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-478e396a-76cb-4daa-9108-1dc6d1dced1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:56.006284 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-478e396a-76cb-4daa-9108-1dc6d1dced1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:56.163923 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-478e396a-76cb-4daa-9108-1dc6d1dced1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:56.173115 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-478e396a-76cb-4daa-9108-1dc6d1dced1d tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1453 microversion: 2.1 time: 0.182071 Nov 02 16:57:56.173787 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 654/1291] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:55 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:56.578716 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-e4f4c80b-30c3-4aff-b27e-600b2194fbe9 req-4fa1e090-77fb-46c5-a4d7-c8fe5120ba1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6e9f89-7228-463b-b906-679a99ec651c", "name": "network-vif-deleted", "tag": "ade707f9-321b-475f-822b-2951865dc9c2"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:57:56.580405 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:57:56.580405 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:57:56.589727 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-e4f4c80b-30c3-4aff-b27e-600b2194fbe9 req-4fa1e090-77fb-46c5-a4d7-c8fe5120ba1d service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:56.590227 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-e4f4c80b-30c3-4aff-b27e-600b2194fbe9 req-4fa1e090-77fb-46c5-a4d7-c8fe5120ba1d service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:56.603855 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-e4f4c80b-30c3-4aff-b27e-600b2194fbe9 req-4fa1e090-77fb-46c5-a4d7-c8fe5120ba1d service nova] Creating event network-vif-deleted:ade707f9-321b-475f-822b-2951865dc9c2 for instance fe6e9f89-7228-463b-b906-679a99ec651c on hv-cinder-77387 Nov 02 16:57:56.610287 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-e4f4c80b-30c3-4aff-b27e-600b2194fbe9 req-4fa1e090-77fb-46c5-a4d7-c8fe5120ba1d service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036059 Nov 02 16:57:56.610992 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 638/1292] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:57:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:57:57.192306 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-7dd93461-1400-4880-86c9-eba70cc798a7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:57.193140 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-7dd93461-1400-4880-86c9-eba70cc798a7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:57.200989 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7dd93461-1400-4880-86c9-eba70cc798a7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:57.201470 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7dd93461-1400-4880-86c9-eba70cc798a7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:57.202290 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7dd93461-1400-4880-86c9-eba70cc798a7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:57.202744 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7dd93461-1400-4880-86c9-eba70cc798a7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:57.240896 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7dd93461-1400-4880-86c9-eba70cc798a7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:57.240896 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-7dd93461-1400-4880-86c9-eba70cc798a7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:57.240896 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-7dd93461-1400-4880-86c9-eba70cc798a7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lazy-loading 'fault' on Instance uuid fe6e9f89-7228-463b-b906-679a99ec651c {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:57:57.289430 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-7dd93461-1400-4880-86c9-eba70cc798a7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '904f531e946b4c37a26ff75451b41923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f5daa1c5be44b48448e0480398d984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:57:57.298790 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-7dd93461-1400-4880-86c9-eba70cc798a7 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 200 len: 1228 microversion: 2.1 time: 0.110637 Nov 02 16:57:57.299448 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 655/1293] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:57 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 1228 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:57:58.319418 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9bd8f72c-e9e0-4436-860a-922c7e29f9e0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:58.320195 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-9bd8f72c-e9e0-4436-860a-922c7e29f9e0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] [instance: fe6e9f89-7228-463b-b906-679a99ec651c] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:57:58.328142 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9bd8f72c-e9e0-4436-860a-922c7e29f9e0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:58.328639 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9bd8f72c-e9e0-4436-860a-922c7e29f9e0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:58.329476 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9bd8f72c-e9e0-4436-860a-922c7e29f9e0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:57:58.329929 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-9bd8f72c-e9e0-4436-860a-922c7e29f9e0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:57:58.344821 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-9bd8f72c-e9e0-4436-860a-922c7e29f9e0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] HTTP exception thrown: Instance fe6e9f89-7228-463b-b906-679a99ec651c could not be found. Nov 02 16:57:58.345471 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-9bd8f72c-e9e0-4436-860a-922c7e29f9e0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Returning 404 to user: Instance fe6e9f89-7228-463b-b906-679a99ec651c could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:57:58.350427 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-9bd8f72c-e9e0-4436-860a-922c7e29f9e0 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c" status: 404 len: 111 microversion: 2.1 time: 0.033684 Nov 02 16:57:58.351080 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 639/1294] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:57:58 2021] GET /compute/v2.1/servers/fe6e9f89-7228-463b-b906-679a99ec651c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:57:58.551551 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-2a5985c9-801d-4ac6-9cad-60fc82474176 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] Calling method '.version_select at 0x7f112f3c8430>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:57:58.577770 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-2a5985c9-801d-4ac6-9cad-60fc82474176 tempest-TestShelveInstance-888273277 tempest-TestShelveInstance-888273277-project] 10.222.0.118 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1444697296" status: 202 len: 0 microversion: 2.1 time: 0.030694 Nov 02 16:57:58.578447 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 656/1295] 10.222.0.118 () {58 vars in 1258 bytes} [Tue Nov 2 16:57:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1444697296 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:58:14.532857 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-840b5a5b-169e-4803-8a78-d247c1745c0b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:58:14.533726 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-840b5a5b-169e-4803-8a78-d247c1745c0b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:58:14.540774 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-840b5a5b-169e-4803-8a78-d247c1745c0b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:58:14.541246 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-840b5a5b-169e-4803-8a78-d247c1745c0b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:58:14.542139 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-840b5a5b-169e-4803-8a78-d247c1745c0b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:58:14.542591 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-840b5a5b-169e-4803-8a78-d247c1745c0b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:58:14.642053 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.objects.instance [None req-840b5a5b-169e-4803-8a78-d247c1745c0b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lazy-loading 'services' on Instance uuid 009e55d9-e974-4936-aabc-4c2da4a531c0 {{(pid=127648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:58:14.729695 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-840b5a5b-169e-4803-8a78-d247c1745c0b tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "DELETE /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0/os-volume_attachments/12bb19ba-3773-45c7-8d67-1df6dac95130" status: 202 len: 0 microversion: 2.1 time: 0.201892 Nov 02 16:58:14.730905 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 640/1296] 10.222.0.118 () {58 vars in 1420 bytes} [Tue Nov 2 16:58:14 2021] DELETE /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0/os-volume_attachments/12bb19ba-3773-45c7-8d67-1df6dac95130 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:58:15.857136 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-da1544fc-2638-44f1-b4d3-81d868653994 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:58:15.858071 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-da1544fc-2638-44f1-b4d3-81d868653994 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:58:15.866084 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-da1544fc-2638-44f1-b4d3-81d868653994 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:58:15.866688 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-da1544fc-2638-44f1-b4d3-81d868653994 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:58:15.867531 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-da1544fc-2638-44f1-b4d3-81d868653994 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:58:15.867975 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-da1544fc-2638-44f1-b4d3-81d868653994 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:58:15.899145 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-da1544fc-2638-44f1-b4d3-81d868653994 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Going to try to terminate instance {{(pid=127649) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:58:15.998511 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-da1544fc-2638-44f1-b4d3-81d868653994 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "DELETE /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 204 len: 0 microversion: 2.1 time: 0.145765 Nov 02 16:58:15.999726 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 657/1297] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:58:15 2021] DELETE /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:58:16.015805 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-6a49527f-6941-4748-a2a4-53f99f4ac580 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:58:16.017123 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-6a49527f-6941-4748-a2a4-53f99f4ac580 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:58:16.028044 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6a49527f-6941-4748-a2a4-53f99f4ac580 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:58:16.028749 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6a49527f-6941-4748-a2a4-53f99f4ac580 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:58:16.029852 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6a49527f-6941-4748-a2a4-53f99f4ac580 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:58:16.030313 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-6a49527f-6941-4748-a2a4-53f99f4ac580 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:58:16.223101 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-6a49527f-6941-4748-a2a4-53f99f4ac580 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:58:16.233134 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-6a49527f-6941-4748-a2a4-53f99f4ac580 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 200 len: 1519 microversion: 2.1 time: 0.225984 Nov 02 16:58:16.234015 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 641/1298] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:58:16 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:58:17.253414 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-916d9afa-9925-4383-9d93-2be5a393f681 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:58:17.254108 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-916d9afa-9925-4383-9d93-2be5a393f681 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:58:17.262367 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-916d9afa-9925-4383-9d93-2be5a393f681 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:58:17.262835 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-916d9afa-9925-4383-9d93-2be5a393f681 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:58:17.263648 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-916d9afa-9925-4383-9d93-2be5a393f681 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:58:17.264391 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-916d9afa-9925-4383-9d93-2be5a393f681 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:58:17.412719 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-916d9afa-9925-4383-9d93-2be5a393f681 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:58:17.422472 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-916d9afa-9925-4383-9d93-2be5a393f681 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 200 len: 1519 microversion: 2.1 time: 0.173506 Nov 02 16:58:17.423139 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 658/1299] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:58:17 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:58:18.442021 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-27a5e76b-1ebf-4476-abcc-2600c8ced31e tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:58:18.443838 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-27a5e76b-1ebf-4476-abcc-2600c8ced31e tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:58:18.454267 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-27a5e76b-1ebf-4476-abcc-2600c8ced31e tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:58:18.455257 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-27a5e76b-1ebf-4476-abcc-2600c8ced31e tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:58:18.456151 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-27a5e76b-1ebf-4476-abcc-2600c8ced31e tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:58:18.456612 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-27a5e76b-1ebf-4476-abcc-2600c8ced31e tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:58:18.538275 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [req-7c66e188-8944-46d6-9f6f-ed654f6ba40e req-6f3c7ae7-1938-4d03-8efd-032e63e97335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "009e55d9-e974-4936-aabc-4c2da4a531c0", "name": "network-vif-deleted", "tag": "64619a3d-b4d4-4e91-a2c7-b4e7a0d9e71c"}]} {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:58:18.540461 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:58:18.540461 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: warnings.warn(msg) Nov 02 16:58:18.549094 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-7c66e188-8944-46d6-9f6f-ed654f6ba40e req-6f3c7ae7-1938-4d03-8efd-032e63e97335 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:58:18.550085 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [req-7c66e188-8944-46d6-9f6f-ed654f6ba40e req-6f3c7ae7-1938-4d03-8efd-032e63e97335 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:58:18.557534 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-27a5e76b-1ebf-4476-abcc-2600c8ced31e tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af0f259600643a298f91cc818bb0a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf032a045492497845c4c0918f42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:58:18.566622 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-27a5e76b-1ebf-4476-abcc-2600c8ced31e tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 200 len: 1477 microversion: 2.1 time: 0.129385 Nov 02 16:58:18.568202 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.compute.server_external_events [req-7c66e188-8944-46d6-9f6f-ed654f6ba40e req-6f3c7ae7-1938-4d03-8efd-032e63e97335 service nova] Creating event network-vif-deleted:64619a3d-b4d4-4e91-a2c7-b4e7a0d9e71c for instance 009e55d9-e974-4936-aabc-4c2da4a531c0 on hv-cinder-77387 Nov 02 16:58:18.568556 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 642/1300] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:58:18 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 1477 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:58:18.576973 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [req-7c66e188-8944-46d6-9f6f-ed654f6ba40e req-6f3c7ae7-1938-4d03-8efd-032e63e97335 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043067 Nov 02 16:58:18.578297 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 659/1301] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:58:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:58:19.586342 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b24bca6f-cdea-495e-b9d5-0a9898a46a68 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:58:19.587068 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b24bca6f-cdea-495e-b9d5-0a9898a46a68 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] [instance: 009e55d9-e974-4936-aabc-4c2da4a531c0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:58:19.595922 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b24bca6f-cdea-495e-b9d5-0a9898a46a68 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:58:19.596446 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b24bca6f-cdea-495e-b9d5-0a9898a46a68 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:58:19.597270 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b24bca6f-cdea-495e-b9d5-0a9898a46a68 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:58:19.597731 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b24bca6f-cdea-495e-b9d5-0a9898a46a68 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:58:19.614411 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-b24bca6f-cdea-495e-b9d5-0a9898a46a68 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] HTTP exception thrown: Instance 009e55d9-e974-4936-aabc-4c2da4a531c0 could not be found. Nov 02 16:58:19.615126 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b24bca6f-cdea-495e-b9d5-0a9898a46a68 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] Returning 404 to user: Instance 009e55d9-e974-4936-aabc-4c2da4a531c0 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:58:19.615983 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b24bca6f-cdea-495e-b9d5-0a9898a46a68 tempest-VolumesSnapshotTestJSON-818441294 tempest-VolumesSnapshotTestJSON-818441294-project] 10.222.0.118 "GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0" status: 404 len: 111 microversion: 2.1 time: 0.033943 Nov 02 16:58:19.616643 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 643/1302] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:58:19 2021] GET /compute/v2.1/servers/009e55d9-e974-4936-aabc-4c2da4a531c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:58:33.142774 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 16:58:33.143757 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: Tue Nov 2 16:58:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 16:59:35.319544 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-36c5b648-e50b-4049-b21e-a926168430bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:59:35.320413 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-36c5b648-e50b-4049-b21e-a926168430bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:59:35.322143 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-6b8b105f-3d4a-4cc8-8c6b-c1486f978f17 req-ed93cdf6-a526-4345-a07a-d6df0ba73f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847f7549-4cec-4009-a558-b95fc18ae3cd", "tag": "0a89a30c-7d46-470e-88a8-5643414f6d1b"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:59:35.324743 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:59:35.324743 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:59:35.334633 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-6b8b105f-3d4a-4cc8-8c6b-c1486f978f17 req-ed93cdf6-a526-4345-a07a-d6df0ba73f41 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:35.335588 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-6b8b105f-3d4a-4cc8-8c6b-c1486f978f17 req-ed93cdf6-a526-4345-a07a-d6df0ba73f41 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:35.339779 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-36c5b648-e50b-4049-b21e-a926168430bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:35.340434 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-36c5b648-e50b-4049-b21e-a926168430bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:35.341628 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-36c5b648-e50b-4049-b21e-a926168430bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:35.342087 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-36c5b648-e50b-4049-b21e-a926168430bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:35.350283 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-6b8b105f-3d4a-4cc8-8c6b-c1486f978f17 req-ed93cdf6-a526-4345-a07a-d6df0ba73f41 service nova] Creating event network-changed:0a89a30c-7d46-470e-88a8-5643414f6d1b for instance 847f7549-4cec-4009-a558-b95fc18ae3cd on hv-cinder-77387 Nov 02 16:59:35.358723 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-6b8b105f-3d4a-4cc8-8c6b-c1486f978f17 req-ed93cdf6-a526-4345-a07a-d6df0ba73f41 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043282 Nov 02 16:59:35.360220 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 644/1303] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:59:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:59:35.378498 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-36c5b648-e50b-4049-b21e-a926168430bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Going to try to terminate instance {{(pid=127649) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:59:35.517763 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-36c5b648-e50b-4049-b21e-a926168430bb tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "DELETE /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 204 len: 0 microversion: 2.1 time: 0.204887 Nov 02 16:59:35.519436 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 660/1304] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:59:35 2021] DELETE /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:59:35.531037 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-26be1424-638c-4749-99ca-42a3b63bc2d7 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:59:35.531776 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-26be1424-638c-4749-99ca-42a3b63bc2d7 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:59:35.540099 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-26be1424-638c-4749-99ca-42a3b63bc2d7 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:35.541241 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-26be1424-638c-4749-99ca-42a3b63bc2d7 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:35.543123 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-26be1424-638c-4749-99ca-42a3b63bc2d7 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:35.543930 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-26be1424-638c-4749-99ca-42a3b63bc2d7 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:35.834832 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-26be1424-638c-4749-99ca-42a3b63bc2d7 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:59:35.847841 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-26be1424-638c-4749-99ca-42a3b63bc2d7 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1576 microversion: 2.1 time: 0.321332 Nov 02 16:59:35.849474 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 645/1305] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:59:35 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1576 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:59:36.871789 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-cbd79e8d-a50b-4409-96d9-c030244eb529 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:59:36.872641 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-cbd79e8d-a50b-4409-96d9-c030244eb529 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:59:36.879623 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cbd79e8d-a50b-4409-96d9-c030244eb529 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:36.880086 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cbd79e8d-a50b-4409-96d9-c030244eb529 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:36.880949 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cbd79e8d-a50b-4409-96d9-c030244eb529 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:36.881394 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-cbd79e8d-a50b-4409-96d9-c030244eb529 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:37.032104 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-cbd79e8d-a50b-4409-96d9-c030244eb529 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:59:37.041065 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-cbd79e8d-a50b-4409-96d9-c030244eb529 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1459 microversion: 2.1 time: 0.174356 Nov 02 16:59:37.041614 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 661/1306] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:59:36 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1459 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:59:37.795706 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d506bfca-9788-4f80-8ec6-c815adbbe0e3] AMQP server on 10.222.0.118:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 16:59:37.801374 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-4c4d4d16-860c-41ca-9432-96f5447a1ca8 req-6a465a17-501d-4e26-b47e-7978f20e8b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847f7549-4cec-4009-a558-b95fc18ae3cd", "name": "network-vif-deleted", "tag": "0a89a30c-7d46-470e-88a8-5643414f6d1b"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:59:37.803730 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:59:37.803730 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:59:37.812788 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-4c4d4d16-860c-41ca-9432-96f5447a1ca8 req-6a465a17-501d-4e26-b47e-7978f20e8b56 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:37.816559 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-4c4d4d16-860c-41ca-9432-96f5447a1ca8 req-6a465a17-501d-4e26-b47e-7978f20e8b56 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:37.829145 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-4c4d4d16-860c-41ca-9432-96f5447a1ca8 req-6a465a17-501d-4e26-b47e-7978f20e8b56 service nova] Creating event network-vif-deleted:0a89a30c-7d46-470e-88a8-5643414f6d1b for instance 847f7549-4cec-4009-a558-b95fc18ae3cd on hv-cinder-77387 Nov 02 16:59:37.836940 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-4c4d4d16-860c-41ca-9432-96f5447a1ca8 req-6a465a17-501d-4e26-b47e-7978f20e8b56 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042898 Nov 02 16:59:37.837646 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 646/1307] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:59:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:59:38.061768 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-ec4f39e6-897e-4ff6-8f20-a11c63c44927 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:59:38.062728 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-ec4f39e6-897e-4ff6-8f20-a11c63c44927 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:59:38.070090 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec4f39e6-897e-4ff6-8f20-a11c63c44927 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:38.070533 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec4f39e6-897e-4ff6-8f20-a11c63c44927 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:38.071435 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec4f39e6-897e-4ff6-8f20-a11c63c44927 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:38.071891 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-ec4f39e6-897e-4ff6-8f20-a11c63c44927 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:38.162965 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-ec4f39e6-897e-4ff6-8f20-a11c63c44927 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:59:38.173406 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-ec4f39e6-897e-4ff6-8f20-a11c63c44927 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 200 len: 1227 microversion: 2.1 time: 0.116770 Nov 02 16:59:38.174201 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 662/1308] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:59:38 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 1227 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:59:39.195879 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4a43818a-750a-4a62-a90a-63a5b7893efe tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:59:39.196836 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-4a43818a-750a-4a62-a90a-63a5b7893efe tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 847f7549-4cec-4009-a558-b95fc18ae3cd] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:59:39.217233 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a43818a-750a-4a62-a90a-63a5b7893efe tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:39.217705 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a43818a-750a-4a62-a90a-63a5b7893efe tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:39.218654 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a43818a-750a-4a62-a90a-63a5b7893efe tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:39.219034 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-4a43818a-750a-4a62-a90a-63a5b7893efe tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:39.227276 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO oslo.messaging._drivers.impl_rabbit [-] [d506bfca-9788-4f80-8ec6-c815adbbe0e3] Reconnected to AMQP server on 10.222.0.118:5672 via [amqp] client with port 57530. Nov 02 16:59:39.239892 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-4a43818a-750a-4a62-a90a-63a5b7893efe tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] HTTP exception thrown: Instance 847f7549-4cec-4009-a558-b95fc18ae3cd could not be found. Nov 02 16:59:39.240730 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-4a43818a-750a-4a62-a90a-63a5b7893efe tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Returning 404 to user: Instance 847f7549-4cec-4009-a558-b95fc18ae3cd could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:59:39.241617 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-4a43818a-750a-4a62-a90a-63a5b7893efe tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd" status: 404 len: 111 microversion: 2.1 time: 0.050922 Nov 02 16:59:39.242284 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 647/1309] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:59:39 2021] GET /compute/v2.1/servers/847f7549-4cec-4009-a558-b95fc18ae3cd => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:59:42.687575 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-e462ea48-1e34-4698-bfe6-e3ec303694b5 req-b57c4fd1-1839-42a8-a507-53c3042f2fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e28e803-80b5-48e8-912a-d47cbeed52e0", "tag": "8985118a-dd23-4724-8375-7570b9e9aad0"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:59:42.688623 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-45f7b093-13a2-4136-83de-6ff9fd2c67bf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:59:42.689392 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:59:42.689392 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:59:42.689621 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-45f7b093-13a2-4136-83de-6ff9fd2c67bf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:59:42.698927 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-e462ea48-1e34-4698-bfe6-e3ec303694b5 req-b57c4fd1-1839-42a8-a507-53c3042f2fa2 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:42.699330 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-45f7b093-13a2-4136-83de-6ff9fd2c67bf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:42.699846 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-e462ea48-1e34-4698-bfe6-e3ec303694b5 req-b57c4fd1-1839-42a8-a507-53c3042f2fa2 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:42.700901 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-45f7b093-13a2-4136-83de-6ff9fd2c67bf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:42.701839 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-45f7b093-13a2-4136-83de-6ff9fd2c67bf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:42.702288 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-45f7b093-13a2-4136-83de-6ff9fd2c67bf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:42.733476 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-e462ea48-1e34-4698-bfe6-e3ec303694b5 req-b57c4fd1-1839-42a8-a507-53c3042f2fa2 service nova] Creating event network-changed:8985118a-dd23-4724-8375-7570b9e9aad0 for instance 4e28e803-80b5-48e8-912a-d47cbeed52e0 on hv-cinder-77387 Nov 02 16:59:42.736656 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-45f7b093-13a2-4136-83de-6ff9fd2c67bf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Going to try to terminate instance {{(pid=127649) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 02 16:59:42.742739 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-e462ea48-1e34-4698-bfe6-e3ec303694b5 req-b57c4fd1-1839-42a8-a507-53c3042f2fa2 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059295 Nov 02 16:59:42.743695 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 648/1310] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:59:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 16:59:42.873799 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-45f7b093-13a2-4136-83de-6ff9fd2c67bf tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "DELETE /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 204 len: 0 microversion: 2.1 time: 0.191086 Nov 02 16:59:42.874910 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 663/1311] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:59:42 2021] DELETE /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 16:59:42.888857 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-0901d549-a5cd-45cc-94ec-b0a9d7ca6a63 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:59:42.890945 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-0901d549-a5cd-45cc-94ec-b0a9d7ca6a63 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:59:42.900314 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0901d549-a5cd-45cc-94ec-b0a9d7ca6a63 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:42.900894 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0901d549-a5cd-45cc-94ec-b0a9d7ca6a63 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:42.902408 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0901d549-a5cd-45cc-94ec-b0a9d7ca6a63 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:42.903476 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-0901d549-a5cd-45cc-94ec-b0a9d7ca6a63 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:43.499407 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.policy [None req-0901d549-a5cd-45cc-94ec-b0a9d7ca6a63 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127648) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:59:43.510455 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-0901d549-a5cd-45cc-94ec-b0a9d7ca6a63 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1576 microversion: 2.1 time: 0.629949 Nov 02 16:59:43.521160 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 649/1312] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:59:42 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1576 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:59:44.529955 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-703b90e8-924a-4c68-ad84-991bcdc56680 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:59:44.530802 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-703b90e8-924a-4c68-ad84-991bcdc56680 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:59:44.538379 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-703b90e8-924a-4c68-ad84-991bcdc56680 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:44.538830 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-703b90e8-924a-4c68-ad84-991bcdc56680 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:44.539677 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-703b90e8-924a-4c68-ad84-991bcdc56680 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:44.540123 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-703b90e8-924a-4c68-ad84-991bcdc56680 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:44.721188 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-703b90e8-924a-4c68-ad84-991bcdc56680 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:59:44.731631 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-703b90e8-924a-4c68-ad84-991bcdc56680 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1458 microversion: 2.1 time: 0.206113 Nov 02 16:59:44.732322 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 664/1313] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:59:44 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1458 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:59:45.117070 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [req-e526ad2d-8cda-49e4-960c-9247ed7aa7eb req-7b0b6856-f72c-40d1-a5c0-437251458005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e28e803-80b5-48e8-912a-d47cbeed52e0", "name": "network-vif-deleted", "tag": "8985118a-dd23-4724-8375-7570b9e9aad0"}]} {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 16:59:45.119563 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 16:59:45.119563 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: warnings.warn(msg) Nov 02 16:59:45.134520 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-e526ad2d-8cda-49e4-960c-9247ed7aa7eb req-7b0b6856-f72c-40d1-a5c0-437251458005 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:45.136472 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [req-e526ad2d-8cda-49e4-960c-9247ed7aa7eb req-7b0b6856-f72c-40d1-a5c0-437251458005 service nova] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:45.156653 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.compute.server_external_events [req-e526ad2d-8cda-49e4-960c-9247ed7aa7eb req-7b0b6856-f72c-40d1-a5c0-437251458005 service nova] Creating event network-vif-deleted:8985118a-dd23-4724-8375-7570b9e9aad0 for instance 4e28e803-80b5-48e8-912a-d47cbeed52e0 on hv-cinder-77387 Nov 02 16:59:45.163295 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [req-e526ad2d-8cda-49e4-960c-9247ed7aa7eb req-7b0b6856-f72c-40d1-a5c0-437251458005 service nova] 10.222.0.118 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051086 Nov 02 16:59:45.164223 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 650/1314] 10.222.0.118 () {64 vars in 1322 bytes} [Tue Nov 2 16:59:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 16:59:45.758877 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-77d150ec-a4b2-46eb-9032-71187c8a4a04 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:59:45.759662 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-77d150ec-a4b2-46eb-9032-71187c8a4a04 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:59:45.771475 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77d150ec-a4b2-46eb-9032-71187c8a4a04 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:45.772063 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77d150ec-a4b2-46eb-9032-71187c8a4a04 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:45.773108 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77d150ec-a4b2-46eb-9032-71187c8a4a04 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:45.773615 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77d150ec-a4b2-46eb-9032-71187c8a4a04 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:45.819531 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77d150ec-a4b2-46eb-9032-71187c8a4a04 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:45.819998 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-77d150ec-a4b2-46eb-9032-71187c8a4a04 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:45.820534 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.objects.instance [None req-77d150ec-a4b2-46eb-9032-71187c8a4a04 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lazy-loading 'fault' on Instance uuid 4e28e803-80b5-48e8-912a-d47cbeed52e0 {{(pid=127649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 02 16:59:45.868452 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.policy [None req-77d150ec-a4b2-46eb-9032-71187c8a4a04 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0989d1d66a4c99b6bf4f1820f7c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83b31a72c4f4cc78519ed2dc9bdc400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127649) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 16:59:45.878049 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-77d150ec-a4b2-46eb-9032-71187c8a4a04 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 200 len: 1186 microversion: 2.1 time: 0.124785 Nov 02 16:59:45.881244 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 665/1315] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:59:45 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 1186 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 16:59:46.913071 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b3eb3e2f-20dc-4664-87ad-39b1c7b6f7db tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:59:46.913948 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-b3eb3e2f-20dc-4664-87ad-39b1c7b6f7db tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 4e28e803-80b5-48e8-912a-d47cbeed52e0] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:59:46.922606 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b3eb3e2f-20dc-4664-87ad-39b1c7b6f7db tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:46.923068 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b3eb3e2f-20dc-4664-87ad-39b1c7b6f7db tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:46.923930 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b3eb3e2f-20dc-4664-87ad-39b1c7b6f7db tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:46.924426 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-b3eb3e2f-20dc-4664-87ad-39b1c7b6f7db tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:46.941611 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-b3eb3e2f-20dc-4664-87ad-39b1c7b6f7db tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] HTTP exception thrown: Instance 4e28e803-80b5-48e8-912a-d47cbeed52e0 could not be found. Nov 02 16:59:46.945396 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-b3eb3e2f-20dc-4664-87ad-39b1c7b6f7db tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Returning 404 to user: Instance 4e28e803-80b5-48e8-912a-d47cbeed52e0 could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:59:46.945396 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-b3eb3e2f-20dc-4664-87ad-39b1c7b6f7db tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0" status: 404 len: 111 microversion: 2.1 time: 0.035495 Nov 02 16:59:46.945396 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 651/1316] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:59:46 2021] GET /compute/v2.1/servers/4e28e803-80b5-48e8-912a-d47cbeed52e0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:59:47.483325 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bd663e9a-b5d8-48ff-b830-0bae0c88aa6b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:59:47.484232 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.compute.api [None req-bd663e9a-b5d8-48ff-b830-0bae0c88aa6b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127649) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:59:47.495385 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bd663e9a-b5d8-48ff-b830-0bae0c88aa6b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:47.495863 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bd663e9a-b5d8-48ff-b830-0bae0c88aa6b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:47.496736 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bd663e9a-b5d8-48ff-b830-0bae0c88aa6b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:47.497179 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG oslo_concurrency.lockutils [None req-bd663e9a-b5d8-48ff-b830-0bae0c88aa6b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:47.512629 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.wsgi [None req-bd663e9a-b5d8-48ff-b830-0bae0c88aa6b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] HTTP exception thrown: Instance 0cc9451a-ff42-4d58-8086-84efeda40e0b could not be found. Nov 02 16:59:47.513272 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-bd663e9a-b5d8-48ff-b830-0bae0c88aa6b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Returning 404 to user: Instance 0cc9451a-ff42-4d58-8086-84efeda40e0b could not be found. {{(pid=127649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:59:47.514176 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-bd663e9a-b5d8-48ff-b830-0bae0c88aa6b tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "DELETE /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 404 len: 111 microversion: 2.1 time: 0.038608 Nov 02 16:59:47.515148 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 666/1317] 10.222.0.118 () {58 vars in 1243 bytes} [Tue Nov 2 16:59:47 2021] DELETE /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:59:47.525166 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cc60b510-e3c5-4b92-8605-38ab75ff27c5 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '>' {{(pid=127648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:59:47.525850 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.compute.api [None req-cc60b510-e3c5-4b92-8605-38ab75ff27c5 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] [instance: 0cc9451a-ff42-4d58-8086-84efeda40e0b] Fetching instance by UUID {{(pid=127648) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 02 16:59:47.532858 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc60b510-e3c5-4b92-8605-38ab75ff27c5 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:47.533330 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc60b510-e3c5-4b92-8605-38ab75ff27c5 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:47.534171 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc60b510-e3c5-4b92-8605-38ab75ff27c5 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 16:59:47.534626 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG oslo_concurrency.lockutils [None req-cc60b510-e3c5-4b92-8605-38ab75ff27c5 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Lock "1bef70f7-4921-43b4-a6be-a07489e3d549" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 16:59:47.553730 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.wsgi [None req-cc60b510-e3c5-4b92-8605-38ab75ff27c5 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] HTTP exception thrown: Instance 0cc9451a-ff42-4d58-8086-84efeda40e0b could not be found. Nov 02 16:59:47.554384 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: DEBUG nova.api.openstack.wsgi [None req-cc60b510-e3c5-4b92-8605-38ab75ff27c5 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Returning 404 to user: Instance 0cc9451a-ff42-4d58-8086-84efeda40e0b could not be found. {{(pid=127648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 02 16:59:47.555301 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO nova.api.openstack.requestlog [None req-cc60b510-e3c5-4b92-8605-38ab75ff27c5 tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b" status: 404 len: 111 microversion: 2.1 time: 0.034591 Nov 02 16:59:47.555932 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: [pid: 127648|app: 0|req: 652/1318] 10.222.0.118 () {58 vars in 1240 bytes} [Tue Nov 2 16:59:47 2021] GET /compute/v2.1/servers/0cc9451a-ff42-4d58-8086-84efeda40e0b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 16:59:48.930150 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: DEBUG nova.api.openstack.wsgi [None req-cc5a1eea-9e4c-4f6e-bc80-9c518ab284fd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] Calling method '.version_select at 0x7f112f7a01f0>' {{(pid=127649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 16:59:48.955113 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO nova.api.openstack.requestlog [None req-cc5a1eea-9e4c-4f6e-bc80-9c518ab284fd tempest-TestVolumeBootPattern-1874102373 tempest-TestVolumeBootPattern-1874102373-project] 10.222.0.118 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-811681611" status: 202 len: 0 microversion: 2.1 time: 0.030362 Nov 02 16:59:48.956008 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: [pid: 127649|app: 0|req: 667/1319] 10.222.0.118 () {58 vars in 1264 bytes} [Tue Nov 2 16:59:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-811681611 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 16:59:50.319433 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 16:59:50.320528 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: Tue Nov 2 16:59:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 17:01:53.161923 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 17:01:53.162901 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: Tue Nov 2 17:01:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 17:01:58.488837 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 17:01:58.489906 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: Tue Nov 2 17:01:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 17:02:01.096598 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 17:02:01.097499 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: Tue Nov 2 17:02:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 17:02:02.288099 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 17:02:02.289009 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: Tue Nov 2 17:02:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 17:03:10.262041 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 17:03:10.262808 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: Tue Nov 2 17:03:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 17:03:10.353010 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 17:03:10.353773 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: Tue Nov 2 17:03:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 17:05:13.180740 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 17:05:13.182764 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: Tue Nov 2 17:05:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 17:05:18.509608 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 17:05:18.510438 dv-cinder-773876-4-iscsi devstack@n-api.service[127648]: Tue Nov 2 17:05:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 17:05:21.118560 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 17:05:21.119361 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: Tue Nov 2 17:05:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 02 17:05:22.308006 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 17:05:22.308991 dv-cinder-773876-4-iscsi devstack@n-api.service[127649]: Tue Nov 2 17:05:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!